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ABSTRACT 


The objective of this research has been to characterize 
in terms of spectral representations and interval distribu- 
tions the univariate point process resulting from the super- 
position of a finite number of independent, identically 
distributed renewal processes with either Erlang or hyper- 
exponential interval distributions. <A corollary to the 
direct line of inquiry has involved a BEOnG class of uni- 
variate point processes known as semi-Markov generated 
Point processes. A semi-Markov generated point process 
may be thought of as a superposition of dependent renewal 
processes. The spectral and distributional characteristics 
are developed for such processes with finite state space, 
and the superposition of renewal processes with Erlang or 
hyperexponential interval distributions is shown to have an 
equivalent representation as a semi-Markov generated point 
process. Equivalence here refers to the probabalistic 
structure of the time between events, and more specifically, 


the spectral properties. 
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io ANT RODUCT ION 


This thesis is concerned with the analysis and proba- 
bilistic properties of point processes which arise from 
superposing a finite number of renewal processes. Most 
previous work in this field has considered the case where 
the number of superposed processes is very large. 

Gae concept Of point process is quite general. A point 
process iS a countable set of primitive events defined on 
a continuum. That is, given a vector space, a point process 
is any set of vectors defined on the space. The research 
recorded in this dissertation deals with a specific class 
of point processes defined cn the non-negative real line, 
(sometimes called a series or stream of events). Moreover, 
they are univariate point processes or series of events in 
that events are Acid penis bic only by where they occur 
Sigune real lame. 

Point processes arise naturally in a wide variety of 
Situations, both deterministic and stochastic in nature. 
For example, the location of the stars in the universe 
relative to the earth coordinate and time system is a 
deterministic point process, while the time, iocation and 
magnitude of earthquakes on the surface of the earth may 
be considered a stochastic point process. 

The analysis of a point process is highly dependent 


upon the nature of the process and the questions to be 
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answered. For this reason, point processes have been 
classified into groups within which similar analytic 
methodology may be applied. 

section A contains a discussion of some of the various 
classifications of point processes, with examples, followed 
imeseculon & by a deseription of those particular point 
processes which are the subject of this research. 

The scope and limitations of the research are delineated 
in Sections C and D, with a general overview of the thesis 
presented in Section E. some of the more significant 
Pesvdts are detailed in Section Ff. 

A summary of previous work relevant to this project 


is presented in Chapter II. 


IT.A. CLASSIFICATION OF POINT PROCESSES 

Recall that a point process is a set of primitive events 
defined on a vector space. Restricting attention to those 
processes which are stochastic in nature, classification 
is based on the dimension of the vector space and the des- 
criptive properties associated with the primitive events. 
ime following subsections describe some fairly general 
Glesses Of POlme Processes. The names @iven Lor the 
classes, while not universally accepted, are commonly used 
(See Lewis, 1972, for further discussion). 

ye ke ee Mule rdimenstonalseoint Process 

The multidimensional point process is 2 set of 

events defined on a multidimensional vector space. Typically, 


although not exclusively, the dimensions are those of space. 


ite) 





An example of such a process might be the list of 
submarine sinkings in World War II recorded by location. 
That is, each element of the point process is identified by 
latitude and longitude only. 

lipneery Loe Mul pivertave POdniearrocess 

A multivariate point process is one for which, in 
addition to its location in a vector space, the events are 
distinguishable by some other qualitative factor. In the 
above example of submarine sinkings, to each location vector 
might be appended the parent alliance (Allied or Axis) of 
the lost submarine. This process would now be classified 
as a two dimensional bivariate point process. 

ioe bne Marked Pong Process 

A marked point process is one for which the events 
have quantitative information associated with each event. 

An obvious example is that of a record of earthquakes which, 
in addition to the time Be onanaeee each event has an 
associated energy level and location vector. 

An example of a univariate, unidimensional, marked 
point process which is easy to visualize is that of arrivals 
at a supermarket checkout center. The vector space is the 
positive time line, while the mark is the value of purchases. 

I.A.4. Classification ty Event Source or Structure 
tivaddtcten. oO the avOverclassoif t\ecation Tistl, potas 
processes are categorized by special characteristics of the 

SolGece of The @vents;, Or Suructure ol Ghe precess. Ihe 


Gefinitions are not precise, and some processes may fall in 
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more than one category. No attempt. will be made here to 
name all the possible categories, but some examples will 
clarify the idea. 

A cluster process is one in which some events are 
generated by a main or driving process, while other events 
are in some way triggered by the main events (Lewis, 1964; 
Vere-Jones, 1970). An example of a cluster process, also 
known as a branching point process, is the sequence of 
landing times aboard an aircraft carrier. If several air- 
craft are assigned a joint mission, the arrival of the first 
aircraft of the group might be considered the main event, 
with the arrival times of the remaining members of the 
group being subsidiary events. 

Another classification of point processes according 
to event source is the superposition of point processes 
(Cox and Smith, 1954; Cox and Lewis, 1966, Ch. 8; Cinlar, 
1972). Under this formulation, the observed events of a 
point process may have originated in any one of several dis- 
GInerepoine. Drocesses, DUE With no indication of whieh 
process was the source. This form of point process is the 
subject of this research, and is explained in more detail 
below; 

A third category is the renewal process to be 


defined in the next section. 


T-B. THE SUPERPOSITION OF RENEWAL POENT PROCESSES 
Much of the analysis of point processes is directed 


Geward cetermining the underlying probabllistic structure 


17 





of a point process based on information gained from a 
statistical sample, or conversely, determining the statis- 
tical properties of a sample from assumptions regarding 
the underlying Structure. 

A univariate point process which has been the object 
SuecwbeMstve suudy 12S the renewal process. A renewal process 
is a univariate point process defined on the non-negative 
real line for which the separations between adjacent events 
are independent, identically distributed random variables. 
It is convenient when discussing unidimensional processes 
to refer to the events as occurrences in time, and to index 
the events accordingly. Thus, given events EB, = t, and 
Be = uae where the indices i and j are taken from the set of 
integers, and the times are measured from some arbitrary 
origin, then ts < v, whenever i < j. 

if several independent renewal point precesses are 
operating concurrently, then the union or pooling of the 
events of all the processes, without regard to which process 
Penerated a particular event, fOrms a Superpositaeon of 
renewal point processes which is itself a univariate point 
process. Figure I.B.1 shows graphically the suverposition 
of two univariate renewal point Brocéases.. The processes 
which contribute events to the superposition process are 
called the component processes. 

While in the general definition of superposition it is 


not necessary that the component precesses be renewal 


Rs 
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Figure I.B.1. Superposed output of two renewal point 
Processes. This illustrates the basic idea of a super- 
position process, Intervals in the component processes 
are independent. In general, the intervals of the 
Superposition process are related. 
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processes, in this thesis the primary interest is in super- 
position of independent renewal processes. However, in 
studying these consideration is given to multivariate or 
multitype processes called semi-Markov processes; the com- 
ponent processes are dependent renewal processes and their 
Supenposition- is called a semi-Markov generated point process. 

some examples will clarify the concept and indicate the 
broad applicability of the superposition model to point 
processes which occur naturally in science and technology. 

Example I.B.1: Nerve ftber pulses. Cox and Smith 
(1954), Cox (1962) and Cox and Lewis (1966) explore the 
hypothesis that the electrical impulses observed in a neuron 
are responses to stimulus from several independent sources. 
Under some distributional assumptions regarding the component 
processes, including the assumption that they are independent, 
a method was developed to estimate the number of processes 
generating impulses in the observed neuron. The methods are 
very ad hoc and hopefully the results of this thesis will 
lead to improved methods of analysis. 

Example 1.B.2: Fatlure patterns of sertes systems, 
In reliability theory, a series system is taken to be a 
piece of equipment which is made up of a combination of 
component parts such that each component must function in 
order for the system to function. Thus the system fails 
each time a component fails. If each component failure 


results in replacement of that component with a component 
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having the same failure time distribution as the original, 
the sequence of system failure times is a univariate super- 
position process. Lewis (1964) and later Downton (1972) 
examined this structure with regard to the nature of the 
stationary failure process as the number of the components 
grows large. 

Example I.B.3: Resupply of a remote activity. An 
activity at great distance from a logistics center is 
resupplied by a fleet of vehicles which traverse a fixed 
route. Assuming that the successive round trip transit 
times for each vehicle may be treated @s a renewal process, 
the arrival pattern of the entire fleet may be represented 
by a univariate superposition process. Barnett (1970) 
studied this problem in order to characterize the time 
between arrivals. 

Example I.B.4: Demand for gas turbine engtnes for DD 
963 class destroyers. <A class of new U. S. Navy destroyers 
will each be equipped with four gas turbine main propulsion 
engines. Each time an engine fails or has been operated for 
@a specified time, it must be replaced. The sequence of 
replacements associated with a particular engine position 
may be taken to be a renewal process. The demand for engines 
emanating from all engine positions on all ships is a uni- 
variate superposition of renewal processes. This demand 
pattern is of interest to planners who must arrange for 


procurement and repair of the gas turbine engines. 
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Example I.B.5: Htghway traffie analysts. Automobiles 
passing a checkpoint on a multilane highway form a super- 
position process. If a counter is placed so that it records 
the passage of cars in all lanes, and the stream of cars 
in each lane is taken to be a point process, the record of 
the counter is that of a superposition process. In this 
example, the component processes may be distinctly non- 
Poisson, non-independent and perhaps non-stationary , 
indicating the broad applicability of the superposition 


process. 


foe SRboeAnCHeOsIPCmMivEsS 

The objective of this research has been to characterize 
in terms of spectral representations and interval distribu- 
tions the univariate point process resulting from the Super- 
position of a finite number of independent, identically 
distributed renewal processes with either Erlang or hyper- 
exponential interval distributions. The ultimate goals 
were to provide the methodology by which a given set of data 
from a univariate point process might be modeled as the 
Superposition of a finite number of Erlang or hyperexponential 
renewal processes, the determination of the number of pro- 
cesses superposed being a key question, or to provide means 
of predicuines the behavior of 2 Sees One eh process based 
on assumptions regarding the finite number of independent 
eomponent renewal processes. 

Dh. Co-Ollanmy 26, bine gqirecte daiaeeor Inquury has 2nvolved 


a broad class of univariate point processes known as 





semi-Markov generated point processes. A semi-Markov process 
may be thought of as a sequence of independent, non-negative 
random variables sampled in accordance with a Markov chain. 
If the sequence of times between transitions are taken as 
interevent times in a univariate point process, a semi- 
Markov generated point process has been defined. This is 
the same as the process given in Cox and Lewis (1966, 

pp. 194) for which the analysis of a two state process is 
presented. The Spectral and distributional characteristics 
are developed for such processes with finite state space, 
and the superposition of renewal processes with Erlang or 
hyperexponential interval distributions is shown to have an 
equivalent representation as a semi-Markov generated point 
process. Equivalence here refers to the probabilistic 
structure of the time between events, and more specifically, 
the spectral properties. 

While a prediction scheme for future behavior of the 
superposition process based on historical knowledge of the 
Breocess 15 NOt one Of the objectives of this work, most 
practical schemes for prediction have been based on the 
SeCecendmorder Securall Properties which are presented nere. 
See, for instance, Yaglom (1962) or more recently Jowett 
and Vere-Jones (1972). In this line it should be pointed 
out that a crucial difference between classical time Series 
(sequences of random variables) and intervals between 


events in a point process is that the former are almost 
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always assumed to be normally distributed, while the inter- 
vals in a point process are positive random variables and 


very non-normal. 


I.D. RESEARCH LIMITATIONS 

In addition to the fact, mentioned above, that the 
prediction problem has not been examined, other interesting 
and relevant topics have not been considered. While a major 
motivation behind the study of superpositions has been 
estimation of the number of component processes (see Cox 
and Lewis, 1966, Ch. 8), no effort has been made here to 
address this problem directly. 

The subject of data analysis with regard to spectral 
and bispectral estimation (see for example Tukey, 1959, and 
Brillinger and Rosenblatt, 1967) is an important area which 
complements the current research, but is not included. 

In reliability, the failure pattern of a series system 
may be modeled as @2 superposition of renewal aeueens 
(Example I.B.2). It might be conjectured that a much broader 
range of system designs may be modeled as semni-Markov genera- 
ted point processes. In view of the resultS reported in 
Chapter V, research in this area might provide an important 
COmpictpur tom tO reolaebiilvey ctheori.. It 1S4neped thar tae 
results presented in this thesis will provide the basis 


for future research along some of the above avenues. 
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I.E. GENERAL OVERVIEW 

This dissertation can be roughly Givided into four 
parts. The first part is direct spectral analysis of the 
hyperexponential and Erlang superpositions (that is, super- 
positions of independent, identically distributed renewal 
point processes with either Erlang or hyperexponential 
interval distributions). Following is an analysis of the 
spectral and distributional properties of a semi-Markov 
generated point process, and the semi-Markov generated 
point process representations of the Erlang and hyperexpo- 
nential superpositions. 

The third part of the thesis involves study of the 
marginal interval density of the superposition of renewal 
processes. - Finally. the formulations of the first three 
parts are developed computationally. 

Chapter II contains a summary Of GetiIn1tiOns. 1Otat Lon 
and basic results regarding point processes in general 
which have application to this FeseanE project. Also in 
Chapter II will be found a brief summary of some of the 
known properties of Superposition processes. 

Chapter JII contains a2 detailed development of the 
second order spectral representation of the Erlang super- 
position process based on the work of Cox and Lewis (1966) 
and Lewis, et al (1973). Some qualitative results are 
established regarding the second order interval spectrum, 


and a relationship with the second order spectrum of a 


n> 
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mixed autoregressive/moving average process is given. An 
expression is derived for the second order spectrum of 
counts, relating it to the count spectrum of a component 
process, and the number of components. Some specific 
Erlang superpositions are examined in detail. 

Chapter IV examines the hyperexponential superposition 
in much the same way. The development iS constrained by 
the unlimited number of parameters in a Benmeral hyper- 
exponential distribution. A two parameter model is studied 
in detail. 

The semi-Markov generated point process is defined and 
analyzed in Chapter V. This process has been used by Lewis 
and Shedler (1973) to model page exception processes in 
multiprogrammed computers. The work of Rudemo (1973) with 
regard to second order count spectra of semi-Markov generated 
point processes is summarized. Joint distributions of inter- 
Veo. Seelal covariances and Naigher Order jo.nt moments are 
derived for this process. The second order spectrum of 
acer ual and the interval bispectrum are shown to be func- 
tions of the Markov transition matrix and tre marginal 
moments of the process. A method is indicated for obtaining 
higher order interval spectra of the semi-Markov generated 
point process. 

In Chapter VI, the "method of stages" is used to model 
hyperexponential and Erlang Superposition processes as 


equivalent semi-Markov generated point processes. It must 
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again be stressed that equivalence refers to probabilistic 
structure, and not physical structure. A state of the 
Markov chain cannot be related to a particular component 
process, but rather contains information regarding the 
overall superposition process. The concept of lumpability 
is employed to reduce the state space associated with the 
superposition process to a workable size. 

In Chapter VII the marginal probability density function 
of an interval in a process formed by superposing independent 
renewal processes is shown to be a function of the survivor 
functions of the component renewal processes, following the 
developmene of Cox and Smith (1954). The relationship between 
the number of processes superposed and the initial value of 
the marginal probability density function of a superposition 
interval is shown to have a simple and useful relationshino 
to the number of component processes. The results derived 
for the superposition of general renewal processes are 
applied to the Erlang and hyperexponential superpositions. 

Numerical testing and tabulation of the results of 
Coapcers til throusm Vil are found in Chapter VIIlL. A 
computer oriented discussion covers such diverse topics as 
the Fast Fourier Transform, and algebraic manipulation com- 
pilers such as FORMAC. Alternative methods of solving the 
various problems are suggested and evaluated quantitatively 
with regard to response to particular questions and computer 
efficiency. Several graphs and tables are presented to 


enable comparison of the various processes, and to indicate 
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the type of information available from this type of analy- 
sis. Included among the graphic displays are second order 
count and interval spectra, marginal densities, and bispectral 
representations. 

T.BE.1. Thesis Organization 

Chapters are numbered with Roman numerals, with 
major sections designated by capital letters. Subsections 
are indexed within the major sections by Arabic numerals, 
with further subdivision marked with lower case letters. 
Thvsspuwseevton Dil, A,e 1s foumd within Section A of 
Chapter III. 

Theorems, lemmas and examples are numbered sequen- 
tially within chapter sections. For example, Theorem III.A.5 
is the fifth Theorem of Section III.A. Equations are num- 
bered sequentially within sections and subsections, with 
chapter reference in Arabic numerals, and enclosed in paren- 
theses. Equation (3.A.2.12) is the twelfth numbered 
hOkmula an subsection Ili vA... 

The designation of figures follows that of the 
tneO@rems. (hat 1s, Yaegure V.A,1 18 first. referenced in 
Cnapeer Vs Section A. 

Appendices follow Chapter VIII and are designated 


by upper case letters. 


epee) SONI CANT Feovies 
Despite the natural occurrence of Superposition pro- 


cesses, there are few analytical results for finite 
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superpositions (see Cinlar, 1972). In order to fill this 
gap, this research has concentrated on the study of super- 
positions of renewal processes having either Erlang or 
hyperexponential distributions. These particular distribu- 
tions were chosen because they are reasonably tractable from 
a computational viewpoint, and they are sufficiently flexi- 
ble in parameterization that in many cases, empirical data 
appears to fit one of the two forms. 

Several interesting results have been established during 
the course of this research which may prove valuable to 
Statisticians working with Superposition processes. 

I.F.1. Spectrum of Intervals and the Relationship of 
the Superposition Process to a Stationary Mixed 
Autoregressive/moving Average Process 

A mixed autoregressive/moving average process of 
orders m and n (ARMA (m,n) process) is a sequence of random 
variables, {Z,}, each element of which is equal to a linear 
combination of the n previous elements of the sequence plus 
a linear combination of m corresponding rancom shocks, where 
the shocks are independent and identically distributed with 
Zero mean and finite variance. A large body of knowledge 
is available regarding this type of process with respect 
to identification of the numbers m and HN, 2novest: nage 
the linear coefficients of the model. The major portion of 
these procedures are based on the serial correlation struc- 
ture, or equivalently the second order spectral structuse 


of the process. See for example Box and Jenkins (1970). 


a 





A superposition process is not a mixed autoregressive/ 
moving average process, nor can it be modeled as one because 
of the non-negativity of the time between events. However, 
the second order spectral structure of the intervals of 
the Erlang and hyperexponential Superposition processes is 
the same as that of a mixed autoregressive/moving average 
process, opening up much of the time series methodology 
for application to this class of stochastic processes. 

This fact is stated as Theorem III.A.2 with proof in 
Chapter V1. 

When a Superposition process and an ARMA process 
have identical second order spectral proverties, the 
Prgecesseogwailil be called is Miiilar . 

I.F.2. The Order of a Similar ARMA Process 

With the establishment of the fact that certain 
types of superposition processes have similar ARMA pro- 
cesses, it was necessary to determine tne relationship in 
detail. Given a sequence of Serial correlation ccefficients 
which may be attributed to an ARMA(m,n) process, what can 
be said about the similar superposition process? 

This question was addressed in Chapter III from the 
inverse point of view. For specific superposition processes, 
the order of the similar ARMA process was determined. For 
a class of Superposition processes, upper bounds on the ARMA 
order were specified. In those cases where a final algebraic 


form for the interval spectrum was determined, the upper 
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bounds were achieved. However, there is evidence that this 
will not always be the case. 


T.F.3. The Structure of a Semi-Markov Generated Point 
Process 


The semi-Markov process may be thought of as n@ 
independent, non-negative random variables sampled in accor- 
Gance with a Markov chain. If the sequence of times between 
samplings is taken to be the time between events in a point 
process, a semi-Markov generated point precess has been 
formed. 

ime .fetmy Strucruire Of Aanvervals in 4 stationary 
semi-Markov generated point process is shown in Chapter V 
to be an easily obtained function of the transition matrix 
and the n° random variables. 

Although this formulation has value in its own 
right, its applicability to this research lies in the fact, 
demonstrated in Chapter VI, that the classes of superposi- 
tion processes under study have equivalent representations 
as semi-Markov generated point processes. That is, the 
univariate point process generated by either the semi- 
Markov process, or the superposition process have identical 
Prepabitistic Structure. Thus, an @ reasonably direct 
way, the spectral structure of all such processes may be 
determined. 

T.F.4. The Inverse of a Characteristic Matrix 
In Section 3 it was stated that the spectral repre- 


sentation of the intervals between events in a2 semi-Markov 





generated point process was an easily obtained function 

of the transition matrix. In fact, the Spectrum is a linear 
combination of terms of the form (Ix-T)71, where this term 
must be evaluated for all (complex) values of x for which 
the inverse exists. In Chapter VIII this problem is 
addressed and three methods of solution are proposed, 


tested and compared. 
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II. PRELIMINARY CONCEPTS AND RESULTS 


The objective of this chapter is to establish the foun- 
dation upon which this research has been based. The work 
of Cox and Lewis (1966) provided much of the point process 
technology, some of which has been expanded here to charac- 
terize certain superposition processes. Where practicable, 
the notation of Cox and Lewis has been adopted. 

Section A contains definitions and notation, along with 
the develooment of some basic results, with regard first to 
the general stationary, univariate, unideimensional point 
processes, then for the Superposition of renewal point 
processes. Finally, the special notation peculiar to the 
Deburcubar (class Or processes under investigation iS intro= 
duced. Appendix A Summarizes the notation found throughout 
‘the thesis. 

Section B contains a brief summary of known results con- 
cerning the superposition of point processes which are of 


interest in the context of this research. 


TI.A. PRELIMINARY NOTATION, NOMENCLATURE AND DEFINITIONS 
Two distinct avenues of reSearch are represented in this 

bnesis. The primary tield 4s that of the superposition of 

independent renewal processes. A second class of processes 

considered are those (univariate) processes generated by 

the transitions of a semi-Markov process. These univariate 


Dewy processes are Calliced SenmlaMarkoy gueneraled poine 
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paocesses. §lMaesinterest in this second class of processes 
stems from certain distributional properties of the hyper- 
exponential and Erlang component processes of a superposition 
which permit the construction of a semi-Markov generated 
point process equivalent to the superposition of independent 
renewal processes. The term "equivalent process" means that 
the probabilistic structure of the point processes generated 
by either method is the same. It must not be inferred that 
superpositions of general renewal processes have equivalent 
semi-Markov generated point processes, nor that every semi- 
Markov generated point process is equivalent to a Superposition 
process. 

While much of the notation and many basic definitions 
are introduced throughout this thesis, particularly with 
regard to the semi-Markov process, some will be presented 
here Which are of @ general nature. 

ieee: Tae Olin Process 

From here forward, unless otherwise specifically 
Sraved, Lue Plrase Polne process will rerer to a Ssvocnhastic, 
Pirelivere toma ls Undiueriare. repularwseries of events. iat 
is to say, tne events are defined on the non-negative real. 
line, and are distinguishable only by their location on the 
line. The regularity condition (Daley and Vere-Jone, 1972, 
DeCe tO oreduines iat the probabllicy ‘ol more than one 
event in an incremental interval, h, is o(h), where the 
Dumas hotends to zero of o(h)7/hale zero. A point. process 


temecome betely ‘count Stationery 11 the finite dimensional 
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Gistributions of counts of events in finite intervals are 
invariant under translation. (See Cox and Lewis, 1966, 
Ch. 4.) 

A point process has four representations which are 
physically equivalent in the sense that knowledge of one 
representation is equivalent to knowledge of the others, 
although the translation from one representation to another 
is not necessarily simple. The representations will be 
referred to as the asynchronous count and interval processes 
and the synchronous count and interval precesses. 

Let BS, be a sequence of iid (independent, iden- 
tically distributed) non-negative random variables. The 
sequence {Xx} is, by definition, stationary since the finite 


Gimensional distributions 


(2221 a 


for all finite sets of indices {i,...,j}, and all real valued 


vectors (Xyoe0 9X ). In a renewal theory context {x} ate 


J 
Ce miledean Oraineanry  Veneicl wiwerval process, iim generals 323 
{x} is a stationary sequence of non-negative random varia- 
bles giving the times between events in a point process, it 
Will be referred to as the Synchronous interval process for 
the point process. The meaning of the word "synchronous" 


will become clear in the discussion of arbitrary events, 


below. 





Directly related to the synchronous interval process 
4s the synchronous counting process,N,(t), which gives the 
number of events in the interval (0,t], where o is the event 
time at which the interval x, commences. Tn general N p(t) 
is not a process with stationary increments. 

There are subtleties connected with the idea of 
selecting an event to start the counting process Which are 
beyond the scope of this thesis. (See Daley, Vere-Jones, 
1972, for more on the Palm-Khinchine theory.) 

To define the asynchronous counting process asso- 
ciated with the point process, let the number of events 
which occur in the interval (t,ttu) be given by N(t,ttu). 
Assume that t was chosen independently of the stationary 


interval sequence Cre Then it can be shown that for any 


meal value fh, 
Pr(N(tth,tthtu) =n] = Pr{N(t,ttu) = nj. 
This stationary property can be extended and expressed as 


1? 


Pr{n(t, ,t Me see NICU ys ee eyed 


un k ie 


' = t a 
Pr(N(t,+h,t}+h) n se esN(t)th,t +h) ny J 
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for any set of k finite intervals, k = 1,2,..., and for all 
real h. Thus, N(t,ttu), representing the number of events 
in an interval of length u from an arbitrary origin, is the 
asynchronous counting process and will be denoted N(u). 
Stationarity of a point process usually is taken to mean 
that N(t,ttu) is a process with stationary increments. 

The aSynchronous interval process is intimately 
connected to the asynchronous counting process. Again, 
taking the basic process to be the synchronous interval 
sequence (Ona ae then the arbitrary origin of the asynchronous 
Counc meuprocess, N(w), Will fallin some interval, say 
Xa The time forward from the arbitrary time of the origin 
until the next event in the process, denoted W, is governed 


by the forward recurrence time distribution (Lawrance, 1970) 


al x 
f Ry(u)du, 


ote Ws le ee), 
O 


where Ry Cu) is the marginal Survivor function for an element 
X of the sequence {x}, arid eX |, 


Including successive intervals, the resulting 


sequence (Wyo yyoXeaoee ed = {W,L,sb53..+} is called the 
asynchroncus interval process. In general, the asynchronous 


interval process is not stationary with respect to the index 
sequence. The main idea here is that the sampling, performed 
by choosing an asynchronous origin, picks out an interval 


K Woteh is leneth-biased (Cox and Lewis. 1966, Ch..4) and 
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doesn't have the same distribution as the intervals {X 1}. 
Moreover the effect persists to successive intervals, e.g. 
! 
Xted? 
The following expressions will clarify the 


relationship of the various representations: 


N(t) < neeWtL, +...4L, > t, n= 1,2,..., C2581,.3) 


Np(t) < nee X_+X, +...4 X, >? tan C2) A .1.4) 
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An arbitrary event is most easily explained in 
terms of the asynchronous counting process. Consider the 
numcer of events in an interval of length u following an 


arbitrary event. This may be defined as (Khintchine, 1960) 


Pr(Np(u)=n] = ae Pr(N(tth,tthtu)=n | N(t,tth)>1] (2.8.1.5) 
h>0+ 


Bauivalentiy, the interval following an arbitrary event is 
xy of the stationary interval process, with the index 
origin chosen arbitrariiy. The word "synchronous" refers 
tO Synchronization with an arbitrary event. 

The interval following an arbitrary event will be 
Meterreageto aS an sroitrary iaberval - 

iP yone tenores the cemblicacizon caused by The ster 


(asynchronous or synchronous) of the process, it may be 


Oeservea from (2.h,1.2) anc €C2sh.1.4) that there are two 





stationary stochastic processes, N(t) and {xX}, which can 
represent the process. ConSequently, there are two (partiy 
related) second order analyses possible: that of the count 
process, N(t), and that of the interval process, © as Both 
are useful, the relative utility depending on the process 
examined. We note that analysis based on N(t) is more 
fundamental, mainly bec@use data often comes aggregated 
(as the number of events in a day, for example) without 
exact times of events. In addition it reflects phenomena 
in continuous time. However, phenomena which are reflected 
in serial number will be more marked in the interval 
Dreper ties. 

Cox and Lewis (1966, Ch. 4), develop several pro- 
perties associeted with point processes. The following 
CUWO SUDSeCLIONS cOntain @ Summary of the pertinent portions 
of that development. 


tiene. PrOeercres and Characverizarions of the 
Counting Process 


Of interest with respect to the counting representa- 
tions are the mean-time curves, M(t) and M(t) for the 
Synchronous and as¥nchronous counting processes, respectively, 
and their intensity functions, m(t) and mp(t). Also the 
covariance density function y(t), the variance-time curve, 
V(t), and the second order spectrum of counts for the 


Svaulonary cOUnNtINg Drocess:. 


By 





Beginning with the asynchronous counting process, 
M(t) = E[N(t)] (2.842. 


is the expected number of events in an interval of length 
t with arbitrary origin. The stationarity of N(t) leads 


tO 
MCE. = £7 5 (2302) 


where u is the expectation of an arbitrary interval. The 
variance-time curve is defined in a natural way for the 


asynchronous process: 
= me 2 
ViG = Eine (t) ) eS NGre | . (ech aap 


The mean-time curve of the synchronous counting 


process is, using the relation (2.A.1.4), 


ti 


EIN.(t)] = 2 Pr{N,(t)ar] 


Matt) 
r=] 


tl 


Aas ; (2.4.2.4) 


I! 
tlm 8 
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where F(t) = Pr[X, +...+ X,<t], taking {X,} to be the 
synchrenous interval sequence. 
The intensity function of a counting process is 


Mery = -e7dtiM(t)}) or mo(t) = d/dtiM.(t)}, where m(t)dt may 
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be thought of as the probability of an event in the 


infinitesimal interval (t,tt+dt). Thus 


m(t) = ut =m, On ome. 


and, when the derivative exists, from (2.A.2.4) 


ton 8 


m,(t) = 
r 


: fenGuy) G24 <2m68) 


where ec 1S the pa? e(orobapidity density Tunciicn) 
associated with Gen 
To develop the covariance function, let daN(t} 

denote the number of events in an increment of time. That 
2S), 

RiGee at) = Nee. 
Then, if the process is assumed to be regular, 

2) 

ELAaN(t)] = ELCAN(t))"~] = ma + o(dt) (2 Je 

and, since (E[aN(t)1)° = o(dt), 


VarCaGe)) = mdb to ato. C2 hoe 


Oorine now av tme Joint expectation, for 7 > 0 


4} 





ELGN(t)daN(ttt)] = PrfdN(t)=dN(t+1)=1] + o(at*) 


mat PREAN(t+t)=1 dN(t)=1] + o(at*) 

a 2 2 

= mm .(t )at + o(dt*). (2 aire. 9) 
Now define the covariance density as 


y.(t) = lim EE (aN(t)-mat) (aN(t+1)-m.(t)at) Vat* 
bs dt+0 f 


= lim [m(m,(t)~-m) + O(a) | 
dt>0 


= m{m (tT )—m} : (2282.20) 


Maintaining consistency with (2.A.2.8) and observing 
that from the stationarity of N(t), y_(-T) = WeAts the 
covariance density function can be defined over the entire 


real line by 


a 


rata. (t )—m} , 13 
y(t) = (Zeer ly) 


6(t)m 3, &. =e 


where 6(t) is the Dirac delta function. This arises essen- 
tially from considering the covariance function of the deri- 
vative of a jump function, N(t), which exists only in the 
sense of peneralized functions (Daley and Vere-Jones, 1972, 


Sect. 4). 


42 





Pine Fourler transtorm of (2-A.2.11) ts 


g(w) = i y(tjen tat, w > 0 (2.A.2.12) 
ow OO 
where 1 =V-1. Since the process is real and stationary, 
m,(t) = m,(-t), and in the limit as t goes to infinity, 
mp(t) tenas to m. his permits the aelternative form of 


the count spectrum (Cox and Lewis, 1966, p. 74) 


¥, x 
g,(w) = mfltm,(iw)tm,(-iw)t/7, w > 0 (Zier s) 
¥ a ” 
where m,(s) = f m,(t )e Seat is the ordinary Laplace trans- 
O 
IMone (ao Uk mp(t). The form of the second order count spectrum 


given by (2.A.2.13) is particularly useful in developing 
spectral forms in the superposition process. 
Further, a very useful relationship exists between 


the variance-time curve and the second order count spectrum: 


Ge) = “ieee ean) (2.A.2.14) 
t+ o> Os 
where V'(t) is taken to be the time derivative of the 
variance-time curve, V(t). That is, the asymptotic slope 
of the variance-time curve is equal to m times the initial 
value of the count spectrum. 


IT.A.3. Properties and Characterizations of the 
Interval Process 


The properties of interest related to the interval 


brocess are the expectation, ELA}; and variance, Var(X), of 


3 





Enea cOiorermyo interval. the eoeltiicrent of variation, 
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C(X) = a Cue seu) 


the auto-correlation sequence {ots and the second order 
spectral density of the interval process, fi (w). 


The autocorrelation sequence, fo,} is given by 
= e _ 
0, = {(ELX X45 1 = Fie /VarOe, jf = 0F2tee.... (2.8.39. 


The second order interval spectral density is the 


POuerer™eransaOrm Ol they autocorrelation sequence. That is, 


Py Mawes cos Jal/n. 0 <5 ws Tt (22h a3.) 
alae 
hn alternative formulation of the spectral density 


GrPtimtervals nas proven very Usezul in this research. Lev 


in Cyan) ane 2 PriN(t)=Jj} (2). 2) 
j=0 
be the probability generating function for N(t), with the 
Laplace transform Ce. Without going into details (see 
Cox and Lewis, 1966, p. 77) which require a development 
mOl germane to this thesis, the interval spectral density 


may be determined from 


Ni, 
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(2.4.3.5) 
This relationship is the basis of one approach to the 
problem considered in this research. 

Pimably, a relationship exists between the initial 


Poeant.o, the count and interval spectra: 
g, (0+) = C°(X)£, (OF) /ELX] . (2.4.3.6) 
TI.A.4. The Superposition Process 


By superposition process, as used hereafter, is 


meant the union of the events of several independent renewal 


point processes. That is, let N,(t) be a stationary countirg 
Brocess Vich Tia imverevens times, for i = 1,..«.,p. Then 
p 
n6P) (4) = -£ N,(t) (meh. 4 aa) 
1=1 
is a stationary superposition process. It should be stressed 
Babe ibom so. 2 Univer latle Soing process. There 16 no 1den= 





Berea rors G1. an ©venu tne the superpositv1Oon weon Its parent 
Breocess=. “Am-obServation Of @.Superposition process is 4 
sequence of times corresponding to the occurrences of events, 
ava NoO- euler ade ly. tanle ‘choraccveristics. 

In general, a superscript of (p) will indicate that 
the superscripted symbol refers to a superposition process 


of COMPONENTS : 
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iri) ae Oe Cn lwo Up ek DOs LUlOn — Vvoecsces 
An Erlang renewal process iS a renewal process 
with interevent times governed by the Erlang pdf, 


f(x) = ee ald ene 


Fe) Xe 20s (2ehaba)) 
In this thesis, the Erlang pdf will be denoted by Y,.(K5A). 

When p iid Erlang renewal processes are superposed, 
the superposition will be called an E(k,p) process. With 
regard to component processes, the term "iid" means that the 
processes are independent and have the same probabilistic 
structure. The scale parameter, A, is suppressed in this 
notation. The sequence of intervals resulting from the 
superposition of p iid Erlang renewal processes will be 
referred to as the synchronous (asynchronous) E(k,p) 
interval process, depending on the starting conditions of 
arbitrary event, or arbitrary time. Denote by nP) 4) tne 
asynchronous E(k,p) counting process and by NEP) (e) the 
synchronous E(k,p) counting process. | 

The hyperezponential renewal process has interevent 


(me Surv Vor function 


J . 
Jv 


Ry (x) Ge exp{-A, x}, x > 0; C2 ee) 


eles 


Gg, =. Phe point =process 
fala 
Resulting from the -supernosition of » hypcrexponential 


a 


where oh De sate ps Gl Ree eevee AVG 


6 





renewal processes will be denoted as an H(k,p3;q,A) process. 
imeriisanOtation, Gg. > (qso+++sG,) and A = (A sees ody). The 
usage of H(k,p3q,A) will be the same as for E(k,p). 

The letters k and p will be reserved for the special 
usage indicated in this section. Thus, p is the number of 
component processes in a superposition, and k is the shape 
parameter of an Erlang distribution, or the number of ex- 
ponential terms in an hyperexponential distribution. The 


exact interpretation of k will generally be clear from the 


CONTE XC. 


tive © hOrERTINO «Or THE SUPERPOSIVION PROCESS 

Known resvits regarding superposition processes may be 
Givrcea, rouchly neo. voree capepories. The First category 
is that of asymptotic and Poisson related preperties, anda 
HS Covered ins Subsection 11.8.1. The seconde category, 
dealing with the counting process and the marginal interval 
is covered in Subsection ieee. Hinagliy, the jJcint inter} 


val and spectral properties are listed in Subsection I1I.B.2. 


Ceas 


7 ‘ee 


Piast. The Asvyrppoure end Pemssen Related Properties 
Ol a SuUperrosi Gs Lon 2 ro 


ihe relatLonship Of vUme FOlLSson process and super-— 
position process is well covered by Cimiear (lero), Phe 
Sist of the result!s presented are 

eee SUNG@eta tarry bread Conditions. if a sStvaticnary 
renewal process is the superpcesition of stationary renewals, 


each is Poisson. 


am 





b. As the number of compcnent processes is increased, 
with the time scale adjusted so that the mean time between 
events in the Superposition is held constant, the resultant 
process 1S approximately Poisson. There are some subtleties 
regarding this asymptotic result which will not be considered 
here as they have no bearing on this research. Essentially, 
the limit holds if no component process contributes inordi- 
nately to the total number of events. 


ieee 2. ©ount end Aroterary Interval Provperties of 
the oUveroOsts2o 7) Process 


several properties of the superposition of indepen- 
dent, stationary renewal processes are additive, and require 


little elaboration. Let N,(t), 1 = 1,...,p, be a set of 


independent, asynchronous renewal counting processes, with 


p 

wP) Ce) = £ N.(t). Clearly, the mean-time and variance- 
j=1 ~ 

time curves are 


mP (4) = M, (t) (2,8.2m) 


Lt 


; 
Te as ae @ 


and 


v§P) (4) 


| ie i Je 


Vaal (2unieen ie) 


i=l 


For ease of notation, suppose the component processes are 
probabilistically identical, where M(t) and V(t) denote the 


(c) 
common forms for the component processes. The, if X 


is 


Spee rolLerary “1nverval 1h a.cOmponen. Process, an Ls 





an arbitrary superposition interval, 
e(x'P)] = etx’) yp. CBee .2) 


The pdf of an arbitrary superposition interval, 
first given by Cox and Smith (1954), is (assuming iid 


component processes) 


ls R.(udau)P™*}, (2.8.2.4) 


e'P (ey = - Ser ce) 
; 


where R(t) is the survivor function of the component process 


Co) 5 


interval and u = E[X Development of this form for 
particular processes is presented in Chapter VII of this 
dissertation. 


Cox and Lewis (1966) give the result 
(p) e _ | 
Mp (t)- mp(t) + (p-1)m 2 ese) 


based on the idea that an arbitrary event in the superposi- 
CUCM Veeecess OCCCUrs a0. 7am agroitureary time in all but one of 
the component processes. 

Enns (1970) determined that fcr the superposition of 
Petre newar- processes. ai the loc survivor funetaon is 
concave (convex), then so is the log survivor function of 
the superposition process. In the terminology of reliability 


theory, if the component processes have monotone hazard rate, 


4g 





then the hazard rate of the superposition is monotone in 
the same direction. 


tie be 3s. oeecend Order Count.Froverties of the 
DUDE POSIULOn Evoesgs 


Takane the covariance function of a stationary 
Coumtane process as in (2.8.2110), and usine (2.8.2.1) and 
(2.B.2.5) yields the covariance function of the stationary 


COlncine process Of the superposition 
ye) = meme) = mI (43 


= pm{m,(t) + (p-1)m - pm} 


py, (t). (2.8e 301) 
Stiitbrerlt wereline the Laplace Granstorm of (2,8,2.5) 
AanCecuOSGl LUG Ine 11 tne expression Lor the count spectrum 


of a stationary process (2.A.1.10) gives 


g6P) (wy) atltm.G yas ee 3S a 
ip p f &) Mp us Ti 


I 


pe, fw). (Zen oe) 


These results have the following interesting inter- 
Puevear on... I[rithe Component processes are iid renewal 


processes, and if eS?) (w) and p are known, then so is Gi Cu) 


Vv_— 


\ 





This in turn determines the interval properties of the 
component processes. Thus, in theory everything is known 
about the process. 

If p is not known, however, it is precisely this 
linearrty, or additivity, that makes pg?) (w) relatively 
nim ormatvive . 

Note that the intervals in the superposition process 
are correlated and their structure is complicated and diffi- 
CUbercoe Lind in practice, However, 1% is this complex 
structure that makes their investigation (particularly 
second order properties) worthwhile for clues to the 
underlying nature of the superposition process. 


11.B.4 Second Order Interv2l Properties of the 
superposition Process 


There iS, in principal, a means of determining the 
second order interval spectrum of the superposition process. 
From tne de finivion Ofeene SuUberoDOsitiOn Of Independent, 
identically distributed renewal processes, and (2.A.3.4), 
it is clear that the generating function of the superposed 


GOUnvINe process is 
(2, ¢) = eP(z,t). (2. ads 


¥ 
Now, $(z2,t) is the inverse Laplace transform of @$ (z,s) 


Weten, :0r a renewal process, is 





x 
i a LCS) 


ase (S (2B?) 
s{l - zf (s)} 


$"(z,8) = 
given by Lewis, et al (1973), where e (o5 is the Laplace 
transform of the renewal interval pdf. The Laplace trans- 
form of (2.B.4.1) yields the information required in 
(2.A.3.5) to determine £'P) Cw), 
The procedure outlined above is explained in more 


detail in Chapter III. The inverse Laplace transform of 


Lat 


(2.B.4.2) is not a trivial problem, nor is the expansion c 
6? (z,t) once ¢(z,t) has been determined. In the case cf 
the E(k,p) process, Lewis, et al (1973) developed a compu- 
tational form which is the Baete for a major vortion of 
this research. 

Ne AOdy yee enst Cty TUNneCbiGn Of several intervars 17 
Thee supe IDOSL eT 1 eCnmprocess was GCerived by Lawrance (1973). 
the basic argument can be illustrated in terms of the join 
@Geviciuey ©1 CVG ed) ecensx intervals in the synchronous inter= 
Val sequence. Conditioning on the first interval starting 
Wier an. evens in. process 1 et t¢ = 0, the probability ther 
them@ers: incerval is tesminated in (t, ,t,+dt) by an event 
in process 1 and the second interval is terminated in 
+dt) by an event in process 2 is 


(tot, 


ae 
£1 (t,)Ry(to)Ry(to-t, (ug) , (2.B.4.3) 





where f,(t), R, (t) and uw, are respectively the pdf, survivor 
PENCE LON@anG expectation Of an arbitrary interval in com- 
ponent process 1, 1 = 1,2. Taking all combinations cof pro- 
CesSesce responsible for an event, and starting conditions. 
expressions of the form (2.B.3.5) are added to give the 
JOint cCensity of the adjacent intervals in the Superposi- 
tion process. In the case of two iid renewal processes, 

the joint density of two adjacent intervals in the 
superposition is 


... (X, 9X5) = f(x, )f (x5) { R(u)du/y 


12% | 
SWS 


+ R(x, )£(x,+x5) R(x, )/u 
+ f(x, Rx Fx, R(x) /u 
+. R(x, )£(x,)R(x\ +x, )/u 


Lawrance (1973) used this procedure to determine serial 
eorreletions. of cGne, two end three lags tor certain pro- 
cesses. In Chapter V of this thesis, the joint density 
function for intervais of a Semi-Markov penerated point 
process is derived, anc used in Chapter VI to derive joint 
itormatrion ~eparding the intezvals of the E(k,p) and 


H(k,p3;a,A) processes. 
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PTT Soh CONDOR UE Ror e Rib Algo Lo OF aie 


E(ie) INTERVAL PROCESS 


The second order spectra of counts and intervals of a 
point process are available from easily derived formulae 
(Cox and Lewis, 1966, Ch. 4). Lewis, et al (1973) have 
established a computational method for determining the 
interval spectrum of an E(k,p) process. While the compu- 
tational method is unwieldy for even small values of k and 
Owes 20D lI Cation provides considerable insight into the 
use of the interval spectrum in the analysis or modelling 
OT ea scot nbeprocess. 

This chavter deals at length with the second order 
interval spectrum of the E(k,p) process, demonstrating some 
Beneral results. The interval spectrum provides a natural 
analytic tool for the superposition because of the cyclic 
nature of the process. For example, if three processes are 
Superposec, approximately every third event comes from 
Peoece.— 2. In Section A, the’ @eneral form of the spectrum 
MS SCscaeblicred. It iS Shewn constructively that the spec-— 
trum is the ratio of finite Gefree polynomials in cos(w/k), 
Where @ 18 the e@reument of che spectrum. A theorem is pro- 
posed which relates the E(k,p) interval spectrum to that 
of a stationary, finite, mixed autoregressive/moving average 
process. 

The special cases of the E(2,p) and E(4,p) processes 


Saeteonstdered.in Section 8. Both processes are shown to 





have spectra expressible as the ratic of finite polynomials 
in cos w, and an upper bound on the order of the polynomials 
is established. 

section C gives the method for determining upper bounds 
forgthne orders of the ARMA process which 2s similar to an 
E(k,p) process. 

ine second order spectrum Of counts is considered in 
Section D. The results of Cox and Lewis (1966, Ch. 4 and 
8) with regard to the count spectrum is applied to the 
Evista SGuvezmpesition process. The initial point of the count 
spectrum is determined for the E(k,p) process. Section E 
contains some remarks regarding the use of the material or 
Chapter III along with the methodology proposed by Cox and 
Lewis (1966) for the characterization of point processes 


ana Box and Jenkins (1970) for AMMA model identification. 


Tit. eels Je yal, SEECTRUMOr AN E(k,p) PROCESS 

We recall again the idea that in a rough sense, the 
Spectrum GO: intervals will be more Informative in analyzing 
SUpPErpOs i tions than the spectrum of counts... This is because 
the inverval srectrum relates to the phenomena related to 
serial number and on the average. every pD-th event comes 
Prom. CG vene Orocessa Inits serialenurmber effecs is a 
nmaacen Beutoutolny “in the data. Im this: section ive 
me pnocem of “direct cCoOnmputation of the wecond order spectrum 


Ol intervalsro: van © (k.b) process are discussed. First, 


Che method of Lewis, et al (1973) which has been used 


Wa 
WT 





successfully to generate numerical representations of the 
E(k,p) interval spectra for various values of k and p. 

The second method for determining the E(k,p) interval 
spectrum is a variation on the first which simplifies the 
determination of an analytic expression in the form of the 
ratio of two cosine polynomials. This second method is 
satisfactory for small values of k and p. 


The Comeyvcactonal Porm Of The bik.0)- Interval 
Specterum 


tT eae ae 





The interval spectrum of a stationary point process 
158 derined to be the Fourier transform of the auto-correla- 


trom. coctt csents, That is (2.A.3.3) 


oy 5 -ijw 
f,(w) oe ree e C2 AN lt) 


where 1 is the square root of -l, and 


E{[X,-E(*) JEX,, ~-E CX) J) 


P 5 zi “Lava. i ° oe eer ere 


POrmmwunMe esymcarOnous process » Let 
Nie) em the Wember of events in (0,6]). 


and denote the generating function of this asynchronous 


Counvinke orocess Dy 


Ne aes Rae) aemt "Oec~ace 1. (sah 





Denote the Laplace transform of $(z,t) by 


6” (z,s) = fe 
@ 


a(S 6) Gk. (apa 3) 


Since |6(z,t)| < 1 for all z and t > 0, this transform 
exists at least for Re|s] > 0. Cox and Lewis (1966, Ch. 4) 
have shown that (3.A.1.1) can be expressed in terms of 
Genes) by (2.8.3.5) 


*, iu * ge 2 
f (w) = aN Oe ree ee) (aah) 


{2¢ (0,0+) ~ E(X)} 
Lewis, et al (1973) noted that in the case of the super- 
pesition of renewal processes, the Laplace transform of 
@ component asynenronous counting process is easily obtained 
Prov uiies ueolece trarmsrorm of the interval dissribution, In 
Bervieowlaonr.s wsing une adentiuty for the synchronous. procegs 


(2vheIe4) 
al 
GC) 2a ewe (3.A.1.5) 


the generating function of the synenronous counting process 


is 


Di So) CeCe jar ee) (3 Ao) 


aoe 


n 
where F(t) = Pe{"e 4, Kt), and P(t) = 1. Then the 
j= 





fiPapilace: transtomimor (S.haleo)) 1s 


x 
6,(255) = Be Sees) ic oe aed ee 
St = vires )} 
where E (a) = f ane GF(t). 
O 


Cox and Lewis (1966, Ch. 4) provide the relation- 
ship between the generating functions of the synchronous 
ena easyncnronous processes: 


on 1 
hee + a J ba(x,u) du. (3.8.1.8) 


The Laplace transform of (3.A.1.8) is 


% 
Le ele, CS) } 
: 


+ -, 3: 
Ss Bt oie leek oe 


* 
¢ (2,8) = 


_ sE(¥){1-zf (s)} + (z-1){1-f" (s)} 


Sane els) } 
(3.8.1.9) 


Thus 5. (Ge for one of the (identically distributed) 
component processes is a function of the Laplace transform 
GPSrhey Mc ervel GConsity. Hote further that the cenerating 
PMG one 1eatne DOOlEC asynchronous process -15;esince the 
component processes are assumed to be independent, 


Nee) tee Mt) 
PP (2,t) = Elz 2 J 





Not) se 
= 


{E[z 


oP (2,t) ee eneeen 


The information required for determining the Laplace 
transform of the asynchronous superposed process is now 
available and can, in principle, be used in the following 
procedure: 


= 
: ie x ee 
6 (2,8) + (z,t) > 6° (2z,t) - RP) (a8) ; C2 ei a.) 


where L and Lee denote the Laplace transformaticn and its 
inverse, respectively. 

Preamble ITiteA.luwPke £2(2,2) process. We now 
determine the Laplace transform of tne generating function 
of the asynchronous counts in the E(2,2) process. The 


Laplace transform of the Erlang density function is 


: ae 
te Gates lee te 7 A.) 


(Shei ee) 
and 


Biv = 27 ie. Cae a) 


SObemtlitine (>. tele), and. sae 12) in (2.4.1.9) eaves 


a 





2s + (3+2) dA 


(2,8) = —gs+ (ote) A 
2{r>“(1-z) + 2rAs + s%} 


Se en eee 
Morwavert (3.8.1.14), 16 is convemtent to Ssubstatvure 
a = -A(1l+ z) and b = -A(l- z), so that 


2 Stee) 


Ns 4 ato (25h 1 rs) 


¥ 
¢ (z,s) = 


Use of a standard inversion formula (Gardner and 


Barnes, 1942; Seliby, 1969) results in 
o(z,t) = (bee2® ~ a%e?®y/(uayd) . (3.A.1.16) 


The generating function of the superposed process 





is then 
O ey, 
66?) (2,6) = $7 (2,¢) 
place ttn (qaz) en tag 2h ty 7076725). 
(2 eiesilewd 7) 
Tmeelaolece transtorm of (3xhwk.17 jas 
pb’ 2atta-z)® , a! 
¥ ae aa a= 
Wages) = jeeee es eee. 
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To continue the general case, Lewis, et al (1973) 
give the general form for the generating function of 


asynchronous counts in an Erlang renewal process: 


k . 
met] (2=1)-/(r-z). © (4.7 (4.1) “}expi-n (1-10) 
jaa JS j 
C3eh ei 10) 


where Ty oseeoTy are the k Gisvtinee roots. of 2. Vseineg 


(3.A.1.19) to form the corresponding generating function 


for the supverposed process results in 


-r 2 (tT -1)t 


bok k t. 
ee Cone) Z ei) > I ee jeJ 
kz J,71 j_=1\jeJ(t.-1) 
BP J ‘Gone wee 


where J = led ee J) is an index vector whose components 
c 


run from 1 tok. The Laplace transform of (3.A.1.20) is 


5 oe 
J 
k ral Cea) 
ve! a 


1 j_=1 ay? 


x ae 
eee) = em ; | 
z j 


elas 


p 
(2. 4.1,.2) 


PurGcher, il can be Shown that by Letting 


Q,(k,p) = "{P) (9 04 ; 
Generar ono: )- lean) 1) 


crac 
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k 2a 
Ce ee 


£6) (w) = Q (kyp) {(1-cosw)P/(aneP)} oe ar 
J 
Dp 


J 


ae MM 


eue. 
1 (ajztby)cy 


(ooh eieee) 


where 
i+ 
ay — = ? cos (StE*#) 3 
jeJ 
i+ 
b, = 2 sin(Sh=#) ) 
ee : 
and 
i+ 
C = I falcon (3.A4.1.23) 
J fe! k 


This computational ferm was used by Lewis, et al 
(1973) to generate numerical representations for several 
E(k,D) processes, and for k = 2, p = 2, 3 and 4 analytic 
expressions were derived. It will receive more attention 
in Cnapter VITI below with regard to computation of interval 
Spectra numerically. 

it4 should be noted (inat Q) (kp) (a fal ee) As 
dititicult to evaluate directly. Two methods of determining 
Q,(k,p) are discussed in Chapter VIII. 


eT iD h Variation Of The Caorwitat tore Method for 
Determining E(i:,n) anterval Srectra 


Toe eeconpucational form (2-N.1L.22) has provem very 


Mieteovernt. dn the nuréerice] @epresentation of E(icjp) interval 


62 





spectra. The modification proposed in this subsection is 
designed to assist in deriving an analytic expression for 
the second order interval spectrum of an E(k,p) process. 
In particular, the relationship of an E(k,p) second order 
interval spectrum anc the spectrum of an ARMA process is 
explored. 

An ARMA(m,n) process has a spectral representation 
WotcdweLs tae ratio of two LTinite polynomials in cosine . 


That is, for the ARMA (m,n) process, 


) (3.4.2.1) 


where the limits of summation correspond to the orders of 
the autoregressive and moving everage components of the 
ARMA process. 

It will be shown (Theorem III.A.2; Chapters V and 
VI) that the E(k,p) second order interval spectrum has the 
form of (3.4.2.1), hence second order serial properties 
1déeéntical with those of an ARFA process. 

This subsection contains the framework through 
which upper bounds for the parameters m andn of (3.A.2.1) 
may be established. 

Observing that a,;, b, and c, (3.A.1.23) depend only 


6m indices in J and not on the order, (3.:A.1.22) can be 
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Welrcvtren ih the alternative form 


Ca 


7 p N L 
£P Cw) 7 a, (kp) ao (r ) a a 
Ak n=l’n (a; +b, Jey 
n n n 
(2.8.52. 2) 
where LL = (Pyoeee ory) is. @ Veetor of Gimension k corres=— 


ponding to each distinct vector J which indicates the number 
of elements of each denomination in J. (The elements eens 

one Lt should retain the subscript n to indicate their 
relationship to Lae This form of notation rapidly becomes 
awkward and where there is no ambiguity the subscripts will 
be sudDpressed.) For example, let k = 5 and J = (3,5,3,3). 


The corresponding index designation vector is L = (0,0,3,9,1°. 





We will call lL An ande~ designation vector. The notation 
(3) is taken to be the multinomial coefficient pi/(ryt...r td, 
Bn@eveprese ius the pumber of discvinct permutations of J. 


Ki KtD-~-1 
ie, sould also se. noted that 2 i = ~, and thar 4 - ( ) 
lege’ p 


is the figurate number for k types of objects taken in sets 
of size p (see Riordan, 1958, pp. 25). In this notation, 
further suppressing the subscript n, the terms of (3.A.1.23) 


may be written 
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sin 
al 


| at 


OTT J +w 
(SES) 


and 


(1-cos (2B) } J 


ui 


Gcae Wan s, 


I 
| a 


co yy 
ed 


Cleamiy., the, coeliiteilenvs (i ) do not depend on the 
n 
@rdqer ot the elements in Loe It will be convenient to com- 


Dimeetina single set, Ry C= Isswangl tuose vectors, + 


which are made up of the same elements. Thus we take 


a 


Ry = SE eeoereny ye tO De thesset Of distinet k=vectore with 


elements {ry s-+-oryt in any order. Le Ry will refer to a 


particular index designation set. In the above example, 


co 


of the same set, R, = 10315050 ,0)). Bie now restate (3,A,242) 


L = (0,0,3,0,1) and Li = (3,1,0,0,0) would both be members 


as 


. 2a 
cy, ) +3 2h 2) 
i. LeR, (as ptby “Yo, 


(l-cos Ww)? 
ea t 


it ote‘ 


£tP (wu) = @, (esp) 


iva “bhdie Lorn , (w) can be examined in detail by examining 


ei 
Cheaters (Olnsimiler terns. 1.24, terns with index 
designators, L, all taken from the same set, RY 

Py ne follovines scares the form of. Une right Nand 
Sigeror:( (2Ac2s4) “vill be examined in detail. It will be 


shown in Lémmas Ili.f&£.]3 and JIiT.A.2 that the ripht hand 





Side is expressable as the ratio of finite polynomials in 
cosine(w/k), with the term (l-cos w)? cancelling out of the 
expression. The proofs are constructive and the algebra is 
cumbersome. However the exposition is considered necessary 
for the computational work which will be addressed in 


Cheaprcr Vir. 


bemmeritit~A.1: For some integer k preater than 1, 


let Ry be the set of k-tuples whose elements are distinct 





permutaticns of {(p,0,0,...,0)}. Denote the elements of Ry 
by L_> Head ee s Senen 
p (k-1) 
p= 
2a) (2- Ee ¥ dcos (nw/k ) 
a a are Torr 
n=l(a, +b, )ey p(1 - cos w) 
nN Yi nN 


for some real sequence td. J}. 


Proof: From €3-h<.2.3), and denoting by n the 


ante) _ emt wy 
> 
kK 


Subcerip tf aL n> “e have 2s p{l-cos ( = psin( 


On Tere) yP 


and = {l-cos ( Pewee. ok. Ved Meine @ 


3 


Lee teo tk veriia 


a5 rE 
ae + be = p 211. 2005 (Rte) ? 5 © (Sete) + sin®(Sente)) 


op* {l- cos (SRT Dee yoye: aes. «. oes erro) 


vane 
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Vetnea sah eco) fives 


ca, it 
a om (3 0.2.7) 


Cue 
ms 
(ay be, ve 


and (3.4.2.5) becomes 


k ca k 
5S oo r (3.83223) 
n=1 (ae oe = 


k k 
=- + 
Dz pl € is o{ I [1-cos (SET) 43? 
n=1 n=1 
K Oomnt l-k 
Jolley (1961, p. 200) gives TI (cos (ee) | =o “(1 =cos. a). 
n=1 
mien Oreer ereditee vo E.F.. Adams of the Smithsonian 
InovLecuce, “Laws 
Deepen Gecosme (3.0.2.9) 


Given the common denominétor, D, the numerator in 
5 5 


Clee oO es 


i onmnt 
N= £ Mt {1l-cos(EES)}P . (3.A.2.10) 


j=l nx¥3 . 


Using the standard trifronometric identities 
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cos(atb) €o5(4)Cos (bd) = sinmte .cin(y) , 
and 


sin(atb) = sin(a)cos(b) + cos(a)sin(b) , (2.8.21 


it is easily shown that 


cos(w/k)cos(2mn/k) ~ sin(w/k)sin(2m/k), 


~ 
cos (S7B*H) 


cos(2mn/k) = cos(2n(k-n)/k), 


and 
sin(2mn/k) = -sin(2a(k-n)/k). (3.4, 22) 
Using (3.A.2.12), (3.A.2.10) may be expressed as 
¥ 
ms k p 
N= ¢£ {fl-cos(w/k)cos(2m/k) + sin(w/k)sin(2mn/k) ] 
n=1 


Dp 
+ [l-cos(w/k)cos(2mn/k) - sin(w/k)sin€2mn/k)] } 


2 o p 
Kio oh I =coOs luk cost enn i)) = (Sintw/kysean(enn7 |) )) dh 
j#n 
¥ 


k 2 O 
fone lees tue cost ein7k 6 = (sinus aosintenmn7k? Jiu 
Jet 


=e 


(2 ieee wale.) 
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# 
where k = [(k-1)/k] , ana 


p p 
{l+cos(w/k)} + f{l-cos(w/k)} , k even 
U(k) = 


p 
{l-cos(w/k)}  , k@odd . 


The symbol |x| is taken to mean the largest integer less 
than or equal to x. 
The product terms in (3.A.2.13) have components 


2 O 
(l-cos(2nrn/k)cos(w/k)) - (sin(2tmn/k)sin(w/k) ) 


1 etn ( we) ~ 2cos(w/k)cos(2mn/k) + Osama 


2 % 
1eOs (2in e)-- Cosiasia) , n= 1,..245k (2 fe Ae 


Let AL = 1 - cos(2mn/k)cos(w/k) and 
Be = sin(2mn/k)sin(w/k). Then components of the first term 


of (3.8. 2,.13) can be written 


p 


Il 
NW mo 


p 
i + =e 
(A, BL? (AL, ae 


, J 
D loa pu 4. ae, \ 
(3) (Av Cee t(-B) J] 


J 
v4 


p 
cas (33) pP-ed ped (3.A.2.15) 
j=0 : 


2 | n 


¥ 
where p = [(pt1)/2]. Since B = ean omy sin (0/ kK )., 


BY = {sin?(2mn/k)[(1-cos*(w/k) J}. Using the results of 
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(rec oF wand cesh.e. 15). (3.8.2.13) can be writcen 


* * 


- ee As D 
N=2E2(8 (23) [l-cos(w/k)cos(2tn/k) ] 
n=l j3=0 


-2) 


23 5 J 
xf sin(2tmn/k) ] [l-cos (w/k)] } 


2p 
x{ I Leos(2mn/k) - cos(w/k)] } 
j#n 


¥: 
K 2 


é Dp 
+ { Tt [cos(2m/k) - cos(w/k)] } UCk) (3.4.2.152) 
n=l 


where 


D D a) 
y coc um/kK) |) ~ k even 


Dp 
[d=-cos(w/k))] =, k odd 


Examination of (3.A.2.15a) reveals that it is a 
polynomial in cos(w/k). The degree of the polynomial is 
most easily Cetermined from inspection of (2.4.2.8). 


mei ting 


K 
” I e¢ 
it - 1 =] j#n 
p Cc. kK / 
_ n 
n=1 


{0 





Meets Clear that-~cacn term of the numerator has at most 


degree (k-1) times the degree of Co. Since each term 


c= {(l-cos(2nrn/k)cos(w/k) + Cuneo nce iow 
it is of degree p. Thus there exists a set of coefficients 
ties) Such that, using standard trigonometric identities 
(Appendix B) 

_  plk-1) . 

i= d_cos (w/k), 

n=0 2 

EPous eOmpletinge the proof of Lemma IIT.A.1. 

Tt is worth noting that the expression p(k-1) 
represents a weak upper bound on the degree of the numerator 
term, N. A tighter upper bound on the degree is 
k|[p(k-1)/k], which follows from Theorem III.A.2 below. 

This Taéet is important in the comparison of the E(k,p) 
interval spectrum with that of a mixed autoregressive/moving 
average process. 

Having estabtlisred in Lemma IIT.A.1 the form of a4 
special class of terms of (3.4.2.2), the more general form 
toreensicerec DSelow.. uernma Llekee 7a. seo thar. 4l)-Vermns 
of the E(k,p) interval spectrum can be expressed in terms 


OF 2cos (u/ ik) 


Penmmnaw cli. 2s Let RK. be the set of all distiner 


permutations of the k-tuple (ryoPooee or), WaeChe ite) Osenered 


J 





tieesum Of he 7 sequal TO pp. Denote the elements of R 


4 v 


by L.> m= i1,...,N, where N is determined from specific 


knowledge of Rye Then 


We 
ca ; Jo 
N Ls i= eee K 
y moo a | ak a Cae ( Sadinee aalhion) 
n=1 (ay +oy er ie mp A 2 
a) n n ~ $§.cos a = 
m=0 J 2 


i = max . 1 | = N ae = . 
where r max,tr.}, and We Ny kr - p 


Ercoor: i<I[teyiaie be showin Parst that in construc une 
a common denominator for (3.A.2.16), all terms containing 
odd powers of sin(w/k) cancel, while even power terms have 
a cosine representeaétion. Following this, it will be shown 
ra 


that the same phenomena oceur in tne numerator when the 


expression is placed over a common denominator. 





Pyeamine the cenominator of (3.A.2.16) first. he 
, k a: 
terms c, ; Le Re, are of the form I {1-cos (3 *)} my and 
n=1 

have as a common multiple, 

s 2rntu,.> 

Nt [l-cos( ¥ ). , where r is the largest of the Pas 
n=1 : 

Wil seeerwien Kecdilniune £he result staved in (3.4.2.9), 
write 
=e : 
Bene (l-cos w)} (SNe ee 


which coincides with one term in the right hand side of 


Moons 2.16). 


(ee 





For the index designation vector L = (r 


applying the identities (3.A.2.11) gives 


k | k 
p - cos(w/k) I COSC21j|7/") + sinto7sk) 2 =z 


a r Sintemi/k). 
: jer J je1 J 


and 


k k 
b, = cos(w/k) I r,sin(2mj/k) + Sint a7) 2 r,cos(2mj/k). 
2 nae 
(3.A.2.18) 


Using (3.A.2.18), form 


i ie ee 
ay + b =p + Fp, +t 2 2 3 ri v,cos(2(j-n)1/k) 
j=l J n=l j=ntl 
k kK 
- 2pf{cos(w/k) © r.cos(27mj/k) - sin(w/k) = r.sin(2aj/k) } 
oe j=1° 
k k 
= Me - 2p{cos(w/k) = r.cos(2nj/k) - sin(w/k) © r.sin(21j/k); 
jel J j=l 2 
(3 .8..2 310) 
Wet Vesa eab ly cela, ed 
YOu 9 ie ge i = oa 4 yt- an fo = ’ 
Now, let ry Pa? al il eters to) 3 Vee ee ere. fhe i, Py 
Tem cieweveccor L' = (rj o-eesry) will be referred to as the 


counter element of L in Ry By “applying vhne aAdenvities 


(gen ec. lly the following exoression is realised: 





2 Coy ae 
ay,tby, <a er 


k k 
-2p{cos(w/k) © r.cos(2nmj/k) + sin(w/k) = r.sin(2aj/k) } 
j=l d j=l ¢ 
C3. 0.220) 


Hiechadetters from (3.A.2.19) only in the sien of “the Pinal 
summation. 

For each element L of Ry there may be at most one 
counter element L' so formed. Where such a counter element 
is formed, a common multiple of the denominator in terms of 
Coyle elo} wii) tnhemude the product of (3.A.2.17) and 
(oe ooo. This product as 

k 


ve ~ p*{ rysin(2nJ ig 
j=l 


k 
Apv t 2 r,cos(e7j/k) }cos (w/k) 
. j=l 


Oe: 2 
Ho coe (a7 4 > r.cos(2nj/k) | 
Jia 


a 


k 
5 Bl Me ane & 
j=l 


eC 


ND 
eer 


‘ 
-/ 


} (Seis 


Sereda 


J 


which is ae second defree polynomial in cos(w/k). 
It is possible that some elements of K. Will not 


have counter elements. This will occur when, for 


7U 





Ls (Pyse-eoP)s Ty = Peypigys 1 = 1,-+-sk-1. In this case 


k 
yr r,sin(2nj/k) = 0. 
=j J 


J 


= \e Hence 


Thus no sin(w/k) terms will appear in a, or (at tp 
the denominator can be expressed as the product of No 

second degree polynomials in cos(w/k) and No = N - aN, 

first degree polynomials in cos(w/k), along with D, Goyer are 


Here, Ni. is the number of element pairs in Ry which are 


} 
mutually counter G€lements. As noted after Lemma III.A.1, 
N is a weak upper bound on the degree of the denominator. 
A more restrictive upper bound actually realized in some 
bese cases 1s 1) = kL N/k] . 

Having established the form of the denominator in 
isereee lo), We Continue wien the proof of Lemma III.A.2 
by examining the numerator. Again, let L and L' be counter 
elements of Ry. Placing just these terms over a common 


denominator gives the expression 


kK : ry! 
<= Pe, 2. a 27 rw + 
ea amby, al Pecos (Goa)! J 

Ja 

k ‘ r-r 

Pak j Nn OT 
pee (a-4- inetd =cos (oe) (3 Ree aes 
et ee Fea k 


where r is the maximum element of L. 
ppoiiieemoociiy the adenttcies M36), 208] )-ane 


e222); Thewweroduetr Terns Of (25.c.c2) are 





k Ve 
Il {1-cos (S274) } J 
aa 

kK fd 


NM {l-cos(w/k)cos(2nj/k) + sin(w/k)sin(21j/k) } J 
gid 


k 4 zZ!—m Ze 
I { © [l-cos(2rj/k)cos(w/k)] 2 [sin(2nj/k)sin(w/k) 1"), 
j=l m=0 


(3.A.2.23) 


and 


Ze 
{1-cos (S44) J 


a 


jal 


Zs 


Z.-mM “) 
{ £ [-cos(2nj/k)cos(w/k) | J [-sin(2nj/k)sin(u/k) (9, 
J) 0 7 


iH 
Ia 


(2a) 


where Z. =r- ree Ctearly. (394.2.23) ditters from (3.4.20e4) 
eniy in the sign of the cOeificient of the odd powers of 
Sin(w/k). 

COnGinuinge wath the proor of “Lemma LIIT.«A.2, to 
simplify the exposition, in (3.A.2.18), (3.A.2.19) and 


— 


(jure 2.20) make Suitable substitutions to let 
ae eee! Bsin(w/k ) 
a, =p - A = Bsin(w/k) 


L 


(a‘tb*) = {V, - A + Bsin(w/k)}2p 
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(at, +be,) Tae = Bsin(w/k) }2p 


SOrtnat «in (3 ahwe.ee ) 


2 


a (a Fy) = 2p[V p-pA-AV +A°-B°sin® (w/k) 


+ B(V,~-p)sin(w/k) J (3.A.2.25) 
and 
a, (aytb®) 7 2p (V, P-pA-AV, $A°-B“ sin’ (w/k) 
~ B(V,~p)sin(w/k)) (3402226) 


Mecimemeleeh 2.20) differs from (3.A.2.25) enly im the sign 
coefficient of sin(w/k). 

Similarly, the product of (3.A4.2.24) and (3.A.2.26) 
Gaiters-=from the product of (3.A.2.23) and (3.A.2.25) 
only in odd powers of sin(w/k), hence summing these two 
Products will result in the cancellation of all odd powers 
of sin(w/k), leaving only the even powers which are readily 
convertible to even powers of cos(w/k). 

Thus, each pair of terms corresponding to mutually 
Sournter elements of Ry when placed over a common denominator, 


Porm a Numerator which is a polynomial in cos(w/k). To put 


(edi 





the entire expression (3.A.2.16) over a common denominator, 


at remains only to mulviply Ne 


the type shown in (3.A.2.21) for each remaining pair of 


in (3.8.2.22) by @ term of 


mutually counter elements in R and a term of the type 


t? 

shown in (3.A.2.20) with the coefficient of sin(w/k) set 

to zero for each remaining element of Ry This will retain 

the form of a polynomial in cos(w/k), thus establishing 

the nature of the numerator in (3.A.2.16). It remains in 

the proof of Lemma III.A.2 to derive the degree of the 

numerator as a polynomial in cos(w/k). 
The degree of the polynomial Ny 


placed over a2 common denominator is typical, and will have 


(3.A.2.22) when 


degree 


= = | 
W eon e(N, 5 ies Ny as 


TM 


Terk 


a= 


where No is-the mumber of palre.of mutvelly coumter elements, 
k 

N, is the number of elements without counters and 2% (eee) 
i=1 

is the number of terms which must appear in the numerator 


to include D, (3.A.2.17) in the denominator. Since 


k 
N. = N — nN W= N+ (r-r,) ana the proof of Lemma 


: a i=l 
TII.A.2 is complete. 
As before, W actually represents a weak upper 
bound, with a more realistic bound being Wes k|W/k] . 
ipa important implication of Lemmas Iil.A.1 and 


im..A.2 is 
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Theorem III.A.1: The second order interval spectrum 


of the E(k,p) process may be written 


N 
yy a cos: (w/k) 


r{P) (y) = Q, (kp) —_———— (3 see eeT) 
x B_cos. (w/k) 


m=0 
iaiemwemoot vol Theorem Til.A.d 18s €@ trivial application of 
bemmas 21T.A.1 and ITlT.A.2. its value lies in that the 
interval spectrum of the E(k,p) process can be written in 
the form of the ratio of finite degree polynomials in cos(w/k). 
Computational experience (discussed in detail in Chapter 


VIE) leeds te the followine: 


(p) 


Trheerem.t [1 .A.2: Lee Py 


(w) be the second order 
interval spectrum of an E(k,p) process expressed as in 
(see e2ee7). Them the rrehntuhand side of (3.4.2.27) ean 


be reduced to 


| er 


Nn 
» a cos Q) 
£:P)(w) = Q,(e,p) SEP ——_—_ (3.A.2.28) 

m 

xr Bo cos w 
Bs m 

In=0 

Where N' = |N/k], and M' = [M/k]. 


Discussion: The difference between (3.A4.2.27) and 
(3.A.2.28) is that the former has polynomials in cos(w/k) 
While the latter has polynomials in cos w. The significance 


of this theorem is that it shows the spectrum of intervals 


eo 





of an Erlang superposition to be Prelisanic as that of a 
mixed autoregressive/moving average process. This permits 
much of the analysis described by Box and Jenkins (1970) 
to be applied to analysis of these superpositions. 

Even though the intervals of the superposition 
process are distinctly non-normal, the second order 
properties upon which much time series analysis is based, 
are the same for both processes. 

Proof of Theorem III.A.2 will be deferred to 
Chapter VI, where it is shown to be a special case of 
Theorem V.B.3. Theorem V.B.3 ascribes the form of (3.A.2.29) 
to the interval spectrum of a semi-Markov generated point 
process, while Chapter VI deais with modeiling the Etk,o) 
process @s such & process. 

It might be conjectured that all spectra which can 
Beeexpresseda in the form of (3.A.2.27), which is nov the 
melon OLerattone! Lunctions Of m, coulda be further reduced 
Gomtne form of (3.8.2.28). That this conjecture is particu- 
lar to the processes considered here and not true in general 
is shovn by the following example: 

Let f, (w) = oJ coos Jw; Q, (k5P) = 1, k= 2, 

N= 1 and M = 38. oe coefficients in the numerator of 

mr h2.27) be 6 and =9) Bet the coefficients of the 

denominator be 10, -9, -8 and 6. The assertion of Theorem III.A.ce 
4s that the coefficients of cos(w/2) and cos(3w/2) must 


be zero in (23.A.2.27). Some simple calculations will verify 


miat (3.A.2.27) represents an identity in this case. 


- RO 








feel, B. 


SPEC Pt OAs! KesuLrs. 


SPECTHA 


E(2,p) AND E(4,p) INTERVAL 


The E(2,p) and E(4,p) processes are particularly amenable 


to analysis because of the simple form of 


cos (STU*Y) (Ly cose) j= 
sin(Std*#) = (-1)9*4sin(w/2), 5 = 
(-1)3sin(w/4), 4 = 
cos (Sad tw) 
i! co). : 
(-1) 9-2) 72 cos (wd), 
sin(=4j"%) 


(-1)9 7? san (w/4), 


the expansions 


Les ex 
es (2s 
ore 

(3. 
cn oe ae 
Jai 33 

es 
J=254 50.42 4c 


In the discussion which follows, terms of the form cos(nw) 


and (cos ie will be treated interchangeably, except where 


ene exact coefficient of a term is significant to the 


a1sewssiOn< 


Rpes. LS juseiFied by the trigonometric 1den— 


tities and the Chebyshev polynomials, both summarized in 


Appendix B, which relate the two forms. 


Elbe). 


The E(2,p) Interval Spectrum 


Pecediuous DUC Straigntviormvard construct10n of the 


E(2,p) interval spectrum leads to the following 


oul 


ee 


rch 





Theorem III.B.1: The second order spectral density 
of the E(2,p) interval process can be written as the ratio 
of two polynomials in cos w as in (3.A.2.28), where N' = p-1 


and m' = |(p-1)/2]. 


Proof: For a given value of p, the class, 92, of 


index designator sets is 


Q = {(p,0),(p-1,1),...;,(p-[p/2],|p/2] )}. (3.8.41) 


From Lemma III.A.1, for L = (p,0), and L = (0,p), 


in the notation of (3.A.2.3), 





p i : 
2a) 2a, 2 pats cos(jw/2) 
a. — 
ee: Dame? a ere 
(a, +b, )e, Cap tbr y)ey p(l-cos w) 


(25 Badane) 


which will be denoted by Po: 


Looking more closely at the numerator of (3.B.1.2), 


p p 
; +c, = {l-cos(w/2)} + {ltcos(w/2)} 


(2) cos) (w/2) 


a 
i 
©) 


eo U8 
Jae 


lp/2 j 
% tay (l+cos w) , (33 Bea 2) 
jag \* 


Using appropriate trigonometric identities and 


Memeine the obvious substitutions, (3.B.1.3) can be written 
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Z lp/2] 
Tics in 


cos ju. (3.8.1.0) 
7 Fes. -@ 


A second obvious case arises when p is even, and 
L = (p-(p/2) ,p/2) 


PGe ska lee) 5 a, =D; b, = 0 andc, = 1, giving 


(p/2.p/72). Then from (3.A.2.3), €3.8.1.1) 


2a, /(artdé) = 2/p, (3.B.1.5) 


which makes no contribution to the hypothesized ratio of 

polynomials. When it is defined, the expression (3.B.1.5) 
' Pp 

will be denoted eee 


The general term in the E(2,p) spectrum is 


R = {(p-n,n),(n,p-n)}. In this case, with © = (p-n,n) 
and L' = (n,p-n), we examine the expression 
2a Pan 
es = ae 3g ee ’ (3.B.1.6) 


a3 7 
(aptby)o, 9 (ayy tby dey, 


with ay, bd, and c, as in (Shanes 3 


Usine (2.8.1.1) and (3.8.1.2) gives 
a, =p t (p-2n)cos(w/2), 


ei = ee (p-2n)cos(w/2), (2 Bade i) 


So that 
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(aftb*) = 2{p*-2pnt2n*+(p-2n) cos (w/2)}, 


(af, +b%,) = 2{p*-2pnt2n*-(p-2n)cos(w/2)},  (3.B.1.8) 
n p-n 
c, = (l+tcos(w/2)) (l-cos(w/2)) : 
and 
p-n n 
ors. = (l+cos(w/2) ) (l=eosiw/2)) . (228. 129) 


The common denominator in (3.B.1.6) becomes 


p-n 
{A°-B“cos*(w/2)}{1-cos*(w/2)} 


wl 
it 


(Oneanean. _ 1.10 
RoE cos ut { (1-cos w)/2} Ve (32.27. 10) 


Hoigeoeorancard tCriconemetric @dentivies, Substituting 
An = p°-2pnt+2n* and BE = p-2n, and recalling from (3.B.1.1) 
and (3.B.1.5) that n ranges from 1 to [(p-1)/2]. 

Phe numeraror of (3.B.126), with (€348.1.10) as a 
common denominator, is 


p-en 


Ne = (ptB_cos(w/2))(A_-B_ cos (w/2))(1+cos(w/2)) 


p-en 
+ (p-B_cos (w/2)) (A+B cos (w/2))(1-cos(w/2)) 
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N = {ptA +B (A, -p) cos (w/2)-Bicos *(u/2) 
pen J 
i (P>y*) cos (w/2) 
jeo\ 9 


in {ptA -B (A, -p) cos (w/2)-Bé (cos*(w/2)} 


p-en J 
p-2 _ 
X os ( 3)! cos w/2) 
p-2n 


3 24 
2{p+A, -BScos*(w/2) s (Po 5") cos (w/2) 


p-en 


SS 


5] 
2{B_ (A_-p)} A ere cos~(w/2) F (3.841). 10) 


ok 
‘ 


Again making simplifying substitutions and invoking 
Mme-appropriavte. tTrazoncmetric adentities, (3.B.1.11) can 


be expressed as 


N = f£ d. cos” w. (2eR ie) 


Combining Ge. b lede) and ses ,i,12) in (33B.1.6) 


gives P| = N/D,° The Next —tep tc to evaluate the summation 





N 
2(1l-cos ne n ; 
5 2 Ce eee) 
ri 


-B“(1+c05 w ) } 


,, P ee ae cree ’. 


(l-cos w)® = Ooeen 
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Recall that in (3.A.2.3) there is a factor (l-cos w)® 
so that 


ea 
(ijcos w)? 2 


r4P 


Fr 


(p ) 
f Cw) 
v n=0 2 


Q, (2p) 


ee as T 
3P gl 
> “ae y BAAS COS ay am ; (272.1. 


rYP n=0 {20°-B“ (1+cos w)} 
non 

Assume p is even. Then each numerator term, (1-cos va nN 
is a polynomial in cos w of order (p/2), n = 0,1,...,p/2-1. 
When the (p/2-1) denominator terms are combined into a common 
denominator, the term No is multiplied by a polynomial of 
order (p/2-1), resulting in a polynomial of order (p-1), 
which 1s the maximum degree of any of the numerator terms. 
Thus for p even, N' and M! of the theorem are confirmed. 

Let p be odd. In this case each numerator term 
(l-cos w)” ie is a polynomial in cos w of degree ((p-1)/2), 
(iO we (ea) yee. Mine wweoduet OF No with the product of 
the (p-1)/2 denominator terms results in a polynomial of 
degree (p-1), which is the maximum of all the numerator 
terms, and again N' and M! are confirmed, thus completing 
the proof of Theorem III.B.1. 

Some specific examples were computed by Lewis et 
al (1973) and the results are shown in Fig. VIII.A.11. 

Pee. she md pb) Specrrum 
ihe construetion of thevinterval spectrum of the 


molep) process is also tediuous, but has value in that a 
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prEOpercvy -common COr-ally Erlang superpositions is illustrated. 
Thee is, if i and Re are members of the same index 
designator set the terms a,] and a,q may have significantly 
different form. For example, let k = 6 and p = 3. Take 

1° = (2,1,0,0,0,0)ana t+=(2,0,0,1,0,0) so that, as in 
eh. 3) 


ao = p-2coss2ntw) Si cos statu) 


= p-cos(w/6) {2cos (w/3)+c0s (2w/3) } 


+ sin(w/6){2sin(w/3)+sin(2w/3) } (293.2. 1) 
and 
a1 = p-2coss2tew) = cos SOntw) 


= p-cos(w/6) {2cos (w/3)+eos (4w/3) } 


+ sin(w/6){2sin(w/3)+cos (4w/3) } 


= p-cos(w/6)cos(w/3)t+sin(w/6)sin(w/3) , (2 2B ee) 


The difference between (3.B.1.1) and (3.B.1.2) evolves from 


the identity 


cos ((2@njtn)/en) = -cos(2mj/en). (23Be es 30) 
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To construct the E(4,p) interval Spcerrum, 10 is 
necessary to identify those terms, ai» which are distinct. 
Comparison of (3.A.2.3) and (3.B.3) reveals that each ay 
can be represented as 
cos(w/4) ; (3.B.2.4) 


a, =p +nsin(w/4) +n 


E ui 2 


where -p < nj, n, < Pp and In, | as In, | <p. A typical set 


2 


Of index designators, Ry contains the permutations of the 


non-negative integers {1,,15,1,>,1,}. From these permutations 
are derived the terms 
215 = pt(1,-1,)sin(w/4)*(y-1,)cos(w/4), eee 
ae = ree ee erlph een aa). a aetrer eT or 
21, = pt(1y-i,)sinlw/4)*(1,-1,)cos(w/4) , = Oo ce 5 er 
21 = pt(1,-1,)sin(w/4)+(1y-1, )cos(w/4) , J = We... aS. 


Bt; = pt(15-1,)sin(w/4)t(1y-1,)cos(w/4) , foe eee Os 


215 = p+(1,-1,)sin(w/4)# (15-1, )cos(w/4) , i = 21....3 2am 
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Uctmer cs Bile >) 3s Inadequate for the analysis as can be 
seen by looking at two distinct sets of index designation 
vectors R, = {1,2,3,4} and R, = {2,2,3,3}. Denoting 


a he Dy es we have 


L. e Ry by 1 and L, 5 
oy g 16 
var = {a, } = {a } 
15° 5=17 °j jel “4 §=9 


This redundancy must be considered when deriving a common 
denominator for (3.A.2.4). 


To relieve this difficulty define the set 


SiGo) aes 


ae Moe dy eres (CW) a oe Dee ee (P7e |e 


where 


S = (p-2m-n,n). (3.3 .250) 


Meath 


Tabulating S(p) gives 


S(p) = {(p,0),(p-2,0),...3(p-2|p/2],0), 


(Delish) sh =s.. Pp a == ai Dec ey eat). 


(p- |p/2], [p/2])}. (Geen 
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Each element corresponds to a set of ordered pairs 
{(tn,; a 


and each pair (n, »n,) has exactly one corresponding element 


+n.) , (tn +n, )} as shown in (3.B.2.4) and (3.B.2.5), 
Sit, SGe)) ae are (In, |, ]n5}) or (In,|,]n, |). 

The special notation developed here for the E(4,p) 
superposition process can be used advantageously to prove 


wine fol owing 


Theorem III.B.2: The second order spectral density 
of the E(4,p) process can be written as the ratio of two 


polynomials in cos w as in (3.A.2.29), where 


Gotopeoy tt. —p» SeemcmG. 9.10, ... 
Nites (3.B.2.8) 


(p+5p-4) /4, oS a Oe WO hea 


(p°+2p-4)/4, op = 2,4,6,... 
i (3.B.2.9) 
2] 
Goer ep= 37s pee 355, 75.20 
Proof: Corresponding to each a) OPCs ie ea es 
the term 
(a+b4) = p*#nS+ns + 2p(n,sin(w/4)+n,cos (w/4)). (Cee lee) 
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The exact form of c, (3.4.2.3) is not available 
from the pair (n,n). This problem is easily handled in 
the computation of the denominator since the contribution of 
all the c, terms is pCa Gieecs w))P as stated in (3.A.2.8). 
The problem in the numerator is more complex and wiil be 
solved indirectly following the construction of the 
denominator. 


It is convenient to partition the set S(p) into 


subsets. Let 
stip) = {(p,0)} 
S“(p) = {(p-23,0), 3 = 1,..-,{(p-1)/2]) 
S3(p) = {(3,3), j = 1,...3p/2}, p even 
y 
SS” (p>) =71 ©0045 p even 
and 
5 4 V 
Sayeed) = Gap) (3.B.2.11) 
v=l 


First, a denominator will be developed for the 
werms corresponding to particular elements of each of the 
subsets listed in (3.B.2.11). The denominator corresponding 


to stip) oeieren, Dy aC Bah eo. ou Gap will also have the 
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denominator given by (3.A.2.9) with p in that expression 
replaced by j = p/2-1,p/2-2,...,p/2-|p/4], inclusive, hence 
Makane mo contribution to the denominator. 

A typical term of s“(p) ts (n, 59), which from 
W2,Be2.1L0) and (3.A.2.3), and using standard trigonometric 


identities, has corresponding common denominator 


a het Zee pee - 
D, = {Pp tn, +2pn,sin(w/4} {p tn, -2pn,sin(w/4)} 
oe ane 
x{p tnj+2pn,cos(w/4)}{p +nj-2pn,cos(w/4) } 
h 
= (acne too ea’ pn heron ne in eee W (S204 252) 
a 1 a a 1 
A typical element of s3(p) will yield the common 
denominator 


De foo#on 


; “+2pn, (sin (w/4)+cos (w/4)} 


1 


es 


5 
ae 


x{p°+2n +2pn, [sin(w/4)-cos(w/4) 1} 


x{p*+2n*-2pn, [sin(w/4)-cos(w/4J} 


aE 


= (p?+2n2)"-{2(p®+2n2)pn,}7+8p ny (1tcos ts) (23738 2213) 


apain derived from standard trigonometric identities. 


o2 








Finally, a typical element of §°?(p) yields the 


common denominator 


De = {p*4nS+n$+2p(n,sin(w/4)+n,cos (w/4) J) 


x({p4n<4n$+2p[n,sin(w/4)+n, cos (w/4) 1} 


x{p*+no4nS+2p[n,sin(w/4)=n cos(w/4) J} 


1 1 


x{p°+nf4n$+2p[n, sin(w/4)-n,cos (w/4) J} 


“4n$-2p[n,sin(w/4 )=n,cos(w/4) J} 


2 
x{p ty 


x{p°4n<4n5-2p[n,sin(w/l)-n, cos (w/4) J} 


x{p°4no+ns-2p[n,sin(w/4)+n, cos (w/#) J} 


a 


x{p°+n+n$-2p[n,sin(w/4)+n,cos (w/4) I} 


hy 2 
O B 2 O 2 O Oo 
tn5) =e (20 (Pp tnj+n5)) (nj +n) 


= {(p*+né 


2 


| 


+ 2p (nj tng) (1-cos w) } 


2 


ea Lscee uw) ) . (32.58.2714) 


- 64p°nin, 





The degree of the denominator polynomial, M' in (3.B.2.9), 
is the sum of the degrees of the common denominators for 


each element of S(p). The cardinality of S(p) is 


[p/2] 
Sq) | =Se Ge) 
j=0 
(p°+6p+8)/8, p= 2,4,6,..., 
ae (4.8.2.1 5) 
(p“+lp+3)/8, p= 1,3,5,.-6- 
Similarly, 
Ist(p)| = 2 
p/fe-1, Do = 256. : 
IS“(p) | = |(p-1)/2]| = 
272s b= Se54 (soe. 
|®/2 Dp See Os as 
Isr(p)] = 
Jo. p So 51 «9 
i. p= 2,4,6, ; 
Is‘(p)] = 


ae So oe es 


=) 
s 
| 
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Ly 
IS? ¢p) | = "|Stp)| = 5 “IS'i@y 
v=l 


p(p-2)/€, pe 8 oe oon, 


= (3.B.2.16) 
(p°-1)/8, Peat ss 55 (see 
Eeom (3.28.2,12)5 (3.8.2.13)5 (3-5.2.14)) ane 
Cs) ashe 22 alley me 
Mt = |S*(p)|{degree(D,)} + |$?(p)| (degree (D,)} 
+ |S?(p) | {degree (D,)} 
(p/erl)m(p/2)eeptp=2)78, bp = 29456, 5 
(p-1)/24+2(p*-9)/8, pe= 35 5865-4; 
(po+2p-L)/4, p = 2,4,6,..., 
(p*+2p-3)/4, P= 3,5,Toeees 


wotch 1s (3.8.2.9) of the Theorem. 
Continuing with the proof, begin analysis of the 
numerator with stip). The numerator for this set of terms, 


jmom (3.A.2.10), (3.8.3) and (3.B.4) is 





Pp Dp p 
Gece Cyt teen (asl)) € Ciestnaiyi) t 


= | 
T 


2 p p p 
+ (l-sin®’ (w/4)) {Cltecos(w/4)) + (1-cos(w/4)) } 


Ip/a 2(p+j) 2(p+j) 
= 27 (53) {(sin(w/4)) + (cos(w/4)) }(3.B.2.17) 
j=0 
To show inductively that 
2n 2n =| p/2| 
(cos(w/4)) + (sin(w/4)) = “2 ~a..(cos w)’, (343.2. 18) 
j=o 
observe from the binomial expansion that 
en 
(cos(w/4)) + (sin(w/4)) 
n-1 2 oJ 
=j]= 2% (5) [(cos(w/4)) tT (Sinus 4)) jos (2B. 
n=0 J 


HOI sn s= 1. 
2 a - 
cos (w/4) + sin” (w/4) = 1, 
and for n = 2 


OSHC ant COD = Tree laidindeeos Ga) 


(3+cos w)/4. 
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23 eJ 
Assume that (cos(w/4)) + (sin(w/4)) has the form (3.B.2.18) 
MOM Mea sly ca ea tls: | Lien 


erie. ont] 
(cos (w/4)) + (sin(w/4)) 


n i/2 m 
+ w& 
=l- & ie S a,.(cos w) , (3.B.2.20) 
m=O a 

with |n/2| providing the maximum power of cos w in this 


expression. 


Applying this result to (3.B.2.17) gives 


3p/ 4, DP = 254505453 
W 
NN, = £ a.cos ju, We (3.B.2.21) 
a j=0 J 
(3p-1)/4 > p= So 5 6s 3 
Placing Ny over the combined common denominator of degree 


M' provides a polynomial of degree 


I 


(p°+5p~6)/4, Pp 
W! = W+M! = (2738322) 
(p°+5p-4)/4, Pp 


25.659 ,10.13, 14.2. 


Se fs Ome see. 


To show that N' of (3.B.2.8) is equal to W' of 
(3.B.2.22), it is necessary to examine the structure of 
Meh. 2 sey). in Ivehne Of (3.8.2.9) and Theorem JIL.A.1. <Unar 


Be, 


ott 





f, (uw) ¥.©oe a 


0 3 


to 8 


N 
> a,cos (nw/4 ) 


n=0 
Q, (4p) — (3.B.2.23) 


> B'tcos my 
m=o ™ 


Multiplying the left hand summation in (3.B.2.23) by the 
Genominator of the right hand side gives a series in cos jw. 
Since this series is equal to a series in cos(jw/4), it is 
necessary that the only terms with non-zero coefficients in 
the numerator of the right hand side of (3.B.2.23) have 
index j an integer multiple of 4, by the orthogonality of 
the cosine series. Hence all numerator terms for n not an 
integer multiple of 4 must cancel. It is necessary, then, 
to be concerned only with those terms which will not cancel. 
In particular, the numerator of a given term of 


Sel will be 


p_ 
fe {p-n,sin(w/4)}(1-cos w ) D. 
N OR ee nn eM I ch ep PSE Ree ne a 
: {p/2tn> 


yrepn 


sin w/t) 3c, 


From (3.A.2.3) and the derivation of (3.A.2.8) it is clear 
that 
D 1, 1. 1 
(l-cos w) /c, = (l=cin w/4) Clecos g/74)  Gl=sin w/t) 
ty 
x(l=cos w/4) 
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where 1, as 1, fe 1, + ly = 3p, ‘Sinee it 1s known that all 
coefficients must vanish except those indexed with integer 
multiples of 4, Ny may be considered a polynomial in cos w 
of degree |(4+3p)/4}. Combining this information with 
(3.B.2.9) shows that the degree of Ny» when placed over the 
common denominator for the entire expression, to be 
| (44+3p)/4J+M'-1 which is equal to W’ in (2.B.2.22). ‘The 
details of analysis for SG. v = 3,4 and 5 lead to the 
same result, thus completing the proof of Theorem III.B.c. 
It has been established that the second order 
interval spectrum of an E(4,p) process is that of an 
ARMA(m,n) process with upper bounds given for m and n. 


Some computations are tabulated in Fig. VIII.A.11 which 


reflect these results. 


Piet Cet DEGREES OF THE SECOND ORDER ENTERVAL SPHG@RA 

In Section A of this chapter, Theorem III.A.2 stated 
that the second order interval spectrum of the E(k,p) 
process can be expressed as the ratio of two finite rational 
molynomials in cos Ww (3.A.2.28). It is of interest to 
explore the implications of this theorem. 

For the case in which k is odd, the degree of the 


denominator is bounded by 


rites Coe) aq = (3-02) 
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ktp-1 
p 
POrcotomumcer Of G@1ctuinet terms in (3.4.2.2), and i+ is known 


This can be seen by observing that ( represents the 


fromscemma Lli.A.1 that there is no contribution to «the 


Genciinacvor from whe setoR. = {b,0,0,...,0}. 


1 
Again for k odd, the numerator has degree bounded by 


N' = M't+p+[-p/k]. In (3.A.2.16) it was shown that each set 


R, could be expressed as the ratio of polynomiais of order 


t 


N, +kP-p and Ny 


that these polynomials can be rewritten as polynomials in 


in cos(w/k). Theorem III.A.2 guarantees 


cos w of order [(N, tkr-p )/k] and [N,/k]. From the construc- 
iad Oran Ot: Ry» it can be seen that Ny = kt/(nj!...n,!) where 
n represents tne number of times j appears in Ree et 


is easily shown that N, is &an integral multiple of k for 


iv; 
all t as defined in Lemma III.A.1. When (3.A.2.16) is placed 
over the ensemble common denominator, the numerator becomes 


a, polynomial an €os w of order 


N' = [(N,+kr-p)/kJ+(p-r)-[N, /kJ +M! 
= M'tp+|-p/k] (3.0.2) 
The case in wnich k is even is more difficult. A 


Simple formula is not, in general, available. The procedure 
followed in the exposition of Theorem III.B.2 must be 
mpollbeved.s ti" 3.6.2.3) itt was neted that for k= en, 


cos(2n(jtn)/k) = -cos(2nj/k). Further, 
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Simcen jin )7 Kk) == —-sin(2enj/k). Thus, instead of k distinct 
terms, there are n = k/2 distinct terms, each repeated with 
opposite sign. For example, let k = 8 and p = 3. Let 

be (220 0.0.0 .0.0.50), WLnen a,» as defined in CS hie 3 ie 
aS 


: 
p~2coss2ntw) = COs Li0ntw) 


~ 
r 
U1 


p-cost2tzw) 


Define the set VU" (p) to be the set of all non-negative 
vectors of length n satisfying the following conditions: 
1. The elements of e@€ch vector are arranged in 
non-decreasing order. 
2. The sum of the elements of each vector plus a 
non-negative even integer 18 equal to Pp. 

Fach vector v in V(p) is analogous to an index desig- 
nator set Ry. Hor e@xeamote, if (1.1.53) € y3(9), Le ees ° 
represents the vectors (1,3,1) and (3,1,1). In the 
notation of (3.A.2.3), these vectors represent 24 values 
of ay: 
Gils) G2cost (2mtt) Zo )2cos Cin) /6)e3ces (Comtu)7 6) 


(1,3,1): 9+tcos((27+w)/6)+3cos((4tt+w)/6)+cos( (67tw) /6) 
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(3,1,1): 943cos((2t+w)/6)tcos((41+w)/6)tcos ((67+w) /6) 


Denote the elements of uD) by v t = aren a Go a ie 


1 ed 
Here, |A| denotes the cardinality of the set A. Then the 


degree of the denominator of the interval spectrum is no 


larger than 


LY (p) | 
1E cue eae Jv, len 
a (3.0.3) 


and the degree of the numerator is bounded by 


N' = Meare hs [Pgh ~P tp- |v, [7k|} , (3.0.49 
where |v,| represents the number of distinct values of a; 
which are derived from v,. The difference between (3.C.4) 
and (3.C.2) results from the fact that |v,| is not necessarily 
an integral multiple of k. If Vv. = Crete) Ve y3(3), then 
lv. | = 8, which is not divisible by 6. 


Figure IIlI.C.1 is a table of N' and M! values computed 
bye the method. shown in this. section for various values of 
k and p. Algebraic computations, discussed in Chapter VIII 
have confirmed actual values to be in agreement with the 
estimates for certain specific cases, but lower values are 


indicated for others. 
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k 2 3 4 5 6 re 8 
p 
2 0,1* 1,2* 122k 24o° 253 354 3,4 
3 1,2% 2 ye 3,5% 6, 8% 6,8 Vl soe 3 
y 1, 3% 46 5,8* 13,16 13,16 29,32 27,30 
5 zit 6,9 8,11 24,28 23,27 65,69 56,60 
6 2,5 8,12 ahaa WT 45 26,40 13175136 115,122 
A BRO 11,15 15,20 65,70 41,53 245,251 
8 Siete 14,19 19,25 98,104 74,80 489,497 
9 4,8 17,23 24,30 142,149 108,115 
10 iG 21,27 29,36 199,207 142,150 


Figure II1.C.1 Upper bound estimates for the orders of 
the polynomials representing E(k,p) second-order interval 
spectra. The first element of each pair is degree of the 
denominator. The second is the degree of the numerator. 
Those processes marked with an asterisk have been computed 
eGo are Snown in Pigure VitT,C.5. serial correlation 
analysis of the E(3,5) process indicate the actual degree 
ws (6,60) rather than the indicated (6,9). See Section VIII.E. 
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TII.D. COMMENTS ON THE MIXED AUTOREGRESSIVE/MOVING 
AVERAGE SPECTRUM 


It has been stated (Theorem III.A.2) that the second order 
E(k,p) spectrum has the form of a mixed autoregressive/moving 
average process of degree m and n respectively. An important 
property of a stationary mixed autoregressive/moving average 
process is the relationship of the serial correlations. 


A typical finite ARMA(m,n) process is defined by 


+ + = + + + ) 
Z,.+a,Z,_ ,+---+a,2,_ = e, tb ,e,_,+..-+b e,_) C3755) 


where Zs is the observed value of the process at time t and 
te, } is a sequence of independent identically distributed 
random variables with zero mean. .With m > n the serial 
correlations are given by (Box and Jenkins, 1970) 


= 2 ae Ys C2 De) 


+. ..t 
PL Pye Pym 


HGretie. terst. n lacs. Pyoeee oP, Gepend jointly on ass 
i ool wee am. and Ds > Saeed eee oe 

Since the second order spectrum of a stationary inter- 
val process iS an unique, invertable transformation of the 
serial correlations, it follows that the serial correlations 
of an E(k,p) process have the above property. Thus, those 
sections of Box and Jenkins dealing with model identifica- 
tion can be applied directly to a data set which is suspected 


of having emanated from an E(k,p) process. Figure III.C.1 
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can be used in this respect to assist in determining which 
E(k,p) process might provide the best model. 

Estimation properties for k, p and A of the E(k,p) 
process are unknown. AS a reSult, the statistician must 
apply at once the methodology of Chapter VIII of Cox and 
Lewis (1966) which bases the estimation of p on the variance- 
time curve and the additivity of the counting process in a 
superposition; the results of this chapter regarding inter- 
val series analysis, and the results of Chapter VII of this 
thesis which relate the marginal interval density to the 
number and nature of the component processes. 

YII.E. THE SECOND ORDER COUNT SPECTRUM FOR THE 
Bike p) PROCH Ss 

im €Chapcer Jl, Subsecuion A.2, the second order specirum 
of counts of a stationary point process is introduced 
following Cox and Lewis (1966, Ch. 4). In subsection 
IT.B.3, the extension to the count spectrum of the super- 
position of independent stationary point processes was 
given (Cox and Lewis, 1966, Ch. 8). 

For the sake of completeness, a sketch of those results 
is presented here, and applied to the Erlang superpositicn. 
Recalling (2.A.2.5) and (2.A.2.6), the asynchronous 
intensity of a stationary (regular) process is m = 1/E(X], 

where X denotes the length of an intervai following an 


arbitrary event, and the synchronous intensity is ma(t). 





The intensity function of the synchronous counting 
process generated by the superposition of p independent 


renewal processes is 
(p) e 
me “(t) = m1, (T ) + (p-1)m . (3.E.1) 


The count spectrum of a stationary stochastic process 


is 


co 


Peo) eae (mp(u)=me"* Yau} /ru, w > 0 


which has the alternative form, due to Cox and Lewis 
x yo 
g, (uw) = m{l+m,(iw)tm,(-iw)}/7u, (322 ) 


% 
where mp(s ) is the ordinary one-sided Laplace transform of 
mp,(t). From (2.A.2.6), it is clear that for a renewal 
process 

¥ 
% t 
m(s)=— 4 , (3.E.3) 
{1-f (s)} 
% 2 
where f(t) is the renewal density and f (s) is its Laplace 
Eransiorm. Then for the superposition of renewal processes, 


(3.E.2) can be expressed as 
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x x 
g\P) (w) _ BY f 1t+f (iw)f (-iw) 


sore } 
Deere Cuner (alg te Ciao r (C=tu) 


pg, (w) (sia 


The spectrum of the E(k,p) counting process is given 
% 
by (3.E.4) with f(s) = (A/(ats))*, so that 
Ok 


g,(w) (P)(—— eet 
i CEM (eno )-A 1 Ostia) + Oee ae 


(sy 





Jel 
p : 
5 got j-1 
Ve : (9)(5) =D 2 *(as) «-19'(%5) 
je jel ‘<d 
(3.E.5) 
Evaluating (3.E.5) at 0 gives 

g,(0+) = pr/(ken) . (3.5.6) 


OT 





IV. SECOND ORDER SPECTRAL ANALYSIS 
OF THE H(k,p3;q,4) PROCESS 


The analysis of the last chapter dealt with renewal 
processes with interevent times governed by the Erlang 
Gesuriouleton. One important property of the Erlang distri-— 
DUG ONL S bhae 10 Mas ancreasing hazard rate. That is, if 
X has increasing hazard rate, then <{£(t)/R(t)} is an 
increasing function of t. See Barlow and Prochan (1965) 
for a more detailed discussion of the hazard property. 

Enns (1970) showed that if p iid renewal processes are 
superposed, and the component processes have monotone hazard 
mate, then an arbitrary interval of the superposition 
process has monotone hazard rate. 

It is of interest, therefore, in case one cbserved 2 
superposition of renewal processes in which the times 
between superposed events had a decreasing hazard rate, to 
examine a class of distributions with decreasing hazard 
ENE for the intervals of the component renewal process. 
One such distribution is the hyperexponential which has the 
moOlni~Olsa COnVex coOmbinavion Of exponential distrioutvirons. 
The hyperexponential distribution may be thought of as a 
Sow OheexpDOnenblally Giseriouued random variables, the 
choice of which is governed by a discrete probability law. 
(A more general definition has the parameter of the expo- 


Menvtvial distribution selected from an arbitrary probability 
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Gistribution on the positive real line. The definition 
given for this research project is a special case of the 
more general definition.) The tractability of this distri- 
butional form in obtaining an interval spectrum for the 
superposition process comes from the fact that the Laplace 
transform of the pdf, as in the Erlang case, is a ratio of 
fwatronadl Dunctions in s. 

section A is cGevoted to development of the interval 
spectrum of the hyperexponential superposition process using 
the method described in Chapter III. 

im section 8, the interval Spectrum for the H\2,2:0,%) 
mH worked Out in detail. 

The count spectrum of the H{(2,p3;q,A) process is shown 
Haoeetion C. The complexity of the form of the Laplace 
transform of the hyperexponential pdf precludes in depth 


analysis of either spectral form presented in this chapter. 


IV.A. THE INTERVAL SPECTRUM OF THE H(k,p3qa 


eS 
—— 


sc) PROCESS 
mOormowing the smerhodolosy of Chapter TIIl;, Section 4A. 


the interval spectrum will be determined from the procedure 
iv L 
# & 
ices) > o(z,t) = 6? z,t) ~ @ “P? (2,5), (4.A.1) 
where $¢(z,t) is the generating function of counts for the 


x 
asynchronous compcnent process, and $ (z,s) is its ordinary 


Laplace transform. The symbols L, and ae Genote tne 





Laplace transformation and the inverse Laplace 
transformation, respectively. 

Let N, (t) be a component asynchronous counting process. 
benote the survivor function of the interevent times in 
the component renewal processes by 


@¢ 


R(t) = 
J 


ios 


' q,expt-A. th, | ee eee) 


k k 
winere Gd, 2° 0, A. 0, J = lowee,K;, And, Bea. = FY As = 1. 
j j j=l 9 gz 9 
Then the superposition of the p iid processes is an H(k,p3q,d) 
process. 


The Laplace transform of the component interevent pdf 


is 


I 


% 
f(s) dt 


O 
k 


BOeneOXD1— As HS pat 
a j p{-( j aay 


k 
- te balaiaaler he (4.A.3) 


‘ 


Preom: ( seh. 1.29 ) 


SeIleer Goneeenme: Gy 
s“E(X]{1-2f (s)} 


% 
o (2,8) 





Now, let 


U(s) 


tt 
ray 


Gaon Il (str), (4.8.5) 


H(s) 
p73 J rFj 


i! 
boy 


Somthatl.A.3) can be rewritten as 
x 
foes) = H(s)/UCs). CHA 6) 


Meame (4.4.6), the Laplace transform of the generating 


Hunertron Of ounce. (4.4.4) can be written 


sE[X]{U(s)-~zH(s)}+(z-1){U(s)-H(s)} 


6 (zs) a a 
s E[TX]{U(s)-zH(s)} 


A(s)/B(s), (4.4.7) 


where A(s) and B(s) are defined in the obvious way. 


Then Gardner and Barnes (1942) give 


S| ones 
EC, GZa58)) ez. t) 


i Ma = 


A(s Jexp{s t}/B'(s_) ; Cli 8) 


5 
als 


m 


Hele 





where the values sy m= 1, 2eegiigeare the distinct poles of 
SG.a8 provided there are first order poles only. No 
effort has been made to determine if, in general, i268) 
has only first order poles. This has been the case for 
those specific processes considered. The prime denotes the 
first derivative with respect tos. 

The inversion of Ake) isnot a trivwaal matter, even 
when provided with the general inversion formula. A more 
manageable approach is presented in Chapter VI, wherein the 
H(k,p3;4,A) process is represented as a semi-Markov generated 
point process with equivalent probabilistic structure. 
Further analysis along current lines will, therefore, be 


restricted to the H(2,23;q,A) process. 


eve. ele. INTERVAL SRPECTRUM 6F THE Wie.2 sa.) PROCESS 
The component process residual life distribution for 
time between events is, from (4.A.2) 
R(x) = q,exp{-\, x}+q,exp{-A5x}, 
with corresponding Laplace transform 
ae tqh5)tA,A51/ (8°54). Xo) (4.B.1) 
Des i= [s(q, A, doh hy > S"t+stAji,)>5 ged 


and expectation 


hey = (q, Antagdy)/0A, AD). (4 B.2) 


Ale Z 





Evaluating. cme Laplace transiorm of the count senerating 
munction (4.A.7) in light of (4.4.6), (€4.B.1) and (498.2) 


requires tedious but straightforward algebra. The result 


is 
go pe Re Bagh hag g # hy holed) Mag hotaghy} 
S +s f1-z(q,A,+a545) }4A,4, (1-2) 
: ai is hd tee 92 (4.3.3) 
where 
a = 2(q,A,tG,h,)-1, 
B= a°-W, 2, (1-2) : 
a= (atg)/2 , 
b= (a-8)/2 . ‘Cleese 
Inverting G8) using (4.A.6) results in 
¢(z,t) = [(2y-atB)exp{ati-(2y-a-B)exp{bt]}]/2 , (4.B.5) 
where 
y = hy An l2-1)/( a, A574 544) ; (4.B.6) 





Continuing with the procedure outlined in (4.4.1), 
5 5 -1 2 
OUz,6) =a026") [(2ysors) expd2ats 


2 
+ (2y-a-8) exp{2bt} 


2 
- 8(y -yath,A5(1~z)expfa}] : (25. 7) 


Wemee bp. Ys @ and bas in (4.8.4) and (4.8.6). 
Since a, 8, ¥Y, a and b are independent of t, the Laplace 


transform of (4.B.7) is immediate: 


#(2) o,~1 ec 
¢ (z,s) = (28°) [(2y-at+8) /(s-2a) 


2 
+ (2y-a-8) /(s-2b) 
z B{y°-yatr 2, (1-2)}/(s-a) J (4.8.8) 


Recalling from (3.A.4) that the interval spectral 


Gensity of a stationary point process is given by 


eee *, -iw 
f (wu) = 6 (e~" ,0t)td Ce 0+) 
(26 (0,0+)-E[X])t 


(i Bee) 


x 
the next step is to evaluate 6 (2) 00 5) at s = 0+, so that 
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oS) (2,04) = -2{a7-2ay+y 


where 


a 


“+A, (1-2) }/fa(ae-8*) } 


2 2 Dae 
(z-1) (A-A,A,) +Afz-(z —2A+2), An )+2( 28-3255) +A, 45) 


2A°2. AoE (2-1) °-Az(z~1) J 


FyAatdody = 1-G,4)7-4945 


imeBauation (4,B.10)., let 


and 


So that 


W 


u Soke Pe 
A -2A~+A (142), Ag )F2AA ASF OAGAD) 


2 
Sen = ly _ 
eh (2-30, A5)tHAI, A> 2(A,A5) ; 


2 
2 
A (LA, A_)-2AA,AD-2 CAA) : 


2 
On A An(I-A), 


2 
OA hy An (A~2), 


CA AyA 


Vi 


3 


(4.B.10) 


C4 .B.11) 


Cl see 





2 
ee RZ toot 


5 (4.B.13) 
UZ +V Zt 


Now, making the appropriate substitutions for z in 
(4.B.13), and recalling (4.B.2), (4.B.9) and (4.B.11), 
the interval spectrum of the superposition process may be 


written as 


Fey) = 0 CRWtUT) cos 2wt{VCR+T)+(UtW)Steos w +RU+SV4WT 
in I aaa IR TCT = 


>] 
UWeos 2uwtV(CUtW 20s wtUCty +e 


(4.B.14) 


where 


_ 2 
Q= [A A, A,I/ Lea, 


2 5 
57 2AA ARF (1-2, A5)-A Vis (4.B.15) 


Beyond the observation that the interval spectrum of 
the Gates 05.) process is that of an ARMA(2,2) process, very 
little insight is gained from this method of spectral 
computation. Answers to such questions as the nature of 
Wreeserial correlation sequence @s 4a fTunetion of g and <A, 
mene effect of increased values of k or p, etc., are deeply 
Durried in the simplifying notation. Further analysis 


along this line appears futile. 


mC. THE COUNT SPECTRUM OF THE H(2,p3;¢,A) PROCESS 
Using the procedure of Section III.E, the second order 


Spectrum of the counting process is more easily obtained. 


116 





Heowecumpltemey,vauvenuion iS restricted to the H(2,p3a, A) 
process. 

Boweutone 325.0), (4.8.1) and (4.8.2) yiela the 
followrne expression ror the spectral density of this 


COurnune Drocess ; 
g\P)(w) = pata®-2(1-A,Ag)two}/{(APHu?) (ADA) (H.C.2) 


where A is as defined in the set of Equations (4.B.11). 
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Vio SEMPER RO CE hare: POL 2 ROCESSES 


A class of processes which 4re or direct applacetion to 
this research is that of events marking transitions in a 
semi-Markov process. Tnese processes are studied in this 
chapter. Chapter VI is devoted to describing the Erlang 
and hyperexponential superposition processes as semi-Markov 
generated point processes, and applying the results of this 
chapter. 

In Section A we give the definition of a semi-Markov 
process and univariate semi-Markov generated point process, 
with a brief summary of previous work with regard to this 
model. Section B contains the development cf the interval 
Coveriearce Tunction and second order interval spectrum of 
a semi-Markov generated voint process. in Section C the 
results of Section B @re expanded to the interval trivari- 
g@rce ana bispectrum of intervals, with an indication of 
ene method of extension to higher order multivariance and 
spectra. 

The interest in the higher order joint moments and 
Spectra comes from the fact that the intervals in a semi- 
Markov generated voint process are non-normal; thus the 
process is not completely specified by second order joint 
moments. In examining the higher order moments we hope to 


give a more complete description of the process. 
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WA. THE SEMI-MARKOV GENERATED POINT PROCESS DEFINED 

A very general definition formulated by Smith (1955) of 
a semi-Markov process has ne independent, non-negative 
random wariables, ee ted: = Loeeaols Weun Ciserlputron 
Functions F446); which are sampled in accordance with a 
Markov chain with transition matrix T = {t, 53. At a 
transition time, if the Markov chain makes a transition to 
Seavert. tne Next cransitizon is to j with probability ty 
and tne time bettveen transitions is distributed in 
accordance with 2430v). 

If each transition of the Markov chain is recorded as 
an event in time, the record of events is a semi-Markov 
generated point process. 

In Smith's work, and most subsequent work, the seni- 
Marxov ovrocess iS either a model for a state vrocess, the 


sample functions taking on n levels, or a multivariate 


point process (Cox and Lewis, 1972), i.e., a point process 


i} 


with n event types called a Markov renewal process. Here. 
it is used as the source of an interval sequence in 2 uni- 
variate point process by sunperposing the marginal processes. 
Cherry (1972) developed the mathematical structure of the 
superposition of two Markov renewal processes as multivariate 
point processes. 

As the model of a multivariate point process, it is 
apparent that the sequence of times between successive 


arrivals into state 1 in a semi-Markov process forms a 
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renewals Process 10r each State 1 =91,...«.,n. The distinctive 
feature is that the n renewal processes thus formed are 
dependent. The semi-Markov generated point process is, 
then, a superposition of dependent renewal processes. In 
general, n independent renewal processes form a semi-Merkov 
Process Only if the intervals are exponentially distributed. 
it weld be shown in Chapter V1, however, that it is possible 
to construct a semi-Markov generated point process for which 
the probactilistic structure of the (output) sequence of 
events is the same as that of the supervosition of finitely 
many Erlang or Hyperexponential independent renewal 
processes. 

For the purpose of this analysis, assume the distribu- 
Gaoms Ui ;v) are absolutely continuous and have an associated 


a 
density function f(y). Using bold face tyne to indicate 


matrices, denote by F(v) = cerAaee Che matrix of transi 6n 
time densities. Further, assume the non-central moments 
2) 


r (3) 
= FF “" a ” t t = 7 
Was ELS, 5] east tor » < K; and le tus, } be the 
Matrix of r-th moments. 
lpes Orth notirie at this point that 2m much of what 
follows, the non-central moments of the random variables 


{S, } are all that is required, hence the assumption of 


J 
absolute continuity is unnecessarily strong. The reasons 
mor Lhe supoositiom are to Simplify the exposition, to 
€nsure that the point process will be regular, and finally, 


Bet in the applications proposed the assumption is satisfied, 


thus negatings a requirement for a more rigorous treatment. 
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Let x be the random variable associated with the m-th 
Peis meron Ot thewlarkoy Chain, for m= O0;22,22,..<. Thus 
teabietM—- vb cransition 2s from state 1 to state J; Xo = S44: 
That is, the residence, or sojourn time in state i, condi- 
tioned on eventual transition to state j. Assuming the 
origin of the sequence ie was chosen arbitrarily, and all 
states of the chain are ergodic (see Feller, 1968, or 
Kemeny and Snell, 1960), then Oe is a stationary sequence 
Sieinecervyals, This fact 1s most easily seen by observing 
Ghat tne transition process is stationary, so that the 
probebility of entering a particular state following the 
k-th event approaches a constant as k goes to infinity, 
Peparaless, Of the Starting Conditions. Hence, the finite 
Gimens onal: distributions of {x J are translation invariant 
with respect to the index Sequence. 

Example V.A.1 A wo State Univartate Semt-Markov 
Generated Point Process. Cox and Lewis (1966, pr. 194), 
propose the following example of a univariate semi-Markov 


Point process: 


a5 l-a, 
ie ; 3 M5 2M, <4, 
1-a, Ot, 
f(t) f(t) 
F(t) = oe 6 
f(t) f(t) 


heal 





This model might describe the failure pattern for a machine 

which receives its spare parts from two sources, each source 
having 10s Own faildure time distribution. When a, = a5 = om 
an alternating renewal process is generated. 


V.A.1. The Second Order Count Spectrum of a Semi-Markov 
Generated Point Process 


Rudemo (1973) analyzed in detail a special case of 
a semi-Markov generated point process. In the notation of 


pas chapter. 


Ag exp {-Aj vt, i # j 


13 
fy, (v) = (5-A-1 1) 
0; LT = J; 
and 
ye ae Sore 
do 5 ae td i #7 j 
ty = (Skt 
Oe, {= J 


epee addition, défine the matrix, Q, as the matrix of elements 


hey > ei # He 

Qy3 = (5. ig aeese) 
- ZA ; leas 4 
ify 14 





tie: Interpretation of dsj 15 Ghat 


= 3m <P 


-. ; (dt) - Py, (0) }/at 


G55 it 


| 


where Py sft) 


Dia us < qa 1S the intensity of a transition to stave j 


pivem the system is in state i. 


Pr{system is in state j at t|state i at 0}. 


Assuming the matrix | is irreducible and aperiodic, 


ae Nas stationary vector, 71, such that 
a. (Sobel) 


Similarly, define Pas the jt eiemene Ol Ob, te be tae Jimic 
esepime goes to infinity of the probability that the system 
te an state j; 1.e€., the probability that the system is in 
Sweee ol ay an arbitrary bime, Then, 


~1 


Pp, = fa, ; 6 : LAG) } , (5.A.1.5) 


Let the matrix P(t) = {p,,(t)}. Then as t goes to 
MMit ina cy , P, s(t) * Py; and P(~) is a matrix for which each 


Roy is ae iso, P'(0) = 0, and 


ep ae ae aa : (5.A.1.6) 


p! 
alts) - 


Where the "prime" is used to denote the first derivative. 
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Finally, Rudemo has determined that the asynchronous 


intensity of an event at an arbitrary time is 


m=p'g = atP(m)q , Oo rie erat ae 


and the asynchronous intensity is 
ma(t) = m'P(t)g , | (5.8.1.8) 


Vietewbne VeECtTOr gq = ta;5t5 and 1 indicates the transpose 
Ol 7. 

Having defined and characterized the basic model, 
Rudemo developed a representation for the second order count 


spectrum of the process. Following Cox and Lewis (1966, 


Cie. and as given by (2.A.2.13), 
m ae Ua 
B,4w) = ~{ltm,(iw)+mp(-iw)}, w> 0, (5.821.299 


where 


: Dey cece 
mp(s) = : e (m,(t) ) aie 


hog@meca ere lt. -) amd ><A). 6) 


ma(s) = fe °'n™(P(t)-P(@))g at 
0 


124 





! 
4 
= 
~~ 

” 
rot 
. 


mp (S) (Soha bei) 


where 


fe S"(P(t) - P(m))at. 
O 


% 
P (s) 


Some simple calculations will verify that P(-)Q = 0, 


sOumron: (5.A.1.6) 


Sa{P(t)-P(o)} = {P(t)-P(>)3Q, (ood Tah) 


giving 


: = 
Dae lope Cece) (5.0.1.12) 


Doren owt. i. fs CS.Asle lO) and (5.A.1s12) an (5.4.1.9) 
vielas 


=) ea 
g.(w) = m'{P()+(1-P(m))[(Iwi-Q) +(-Iwi-Q) J}q. (5.A.1.13) 


Two points of interest with regard to Rudemo's work 
morrebrabed to this thesis are worth noting here. First, 
Rudemo's definition of a semi-Markov generated point process 
1s actually somewhat more general than given here in that he 
Permits a subset of states for which transitions are not 


mecOrded in the point process. This is similar to the 


Lee. 





methodology in Chapter VI below wherein some states are 
deleted from the state space representation in order to 
meaquce the Size of the matrices. 

Secondly, the computational procedures presented 
ineeupseetions VILI.B.1 and VII1.B.2 below for finding the 
inverse of a matrix (Iu-T) can be applied to (5.A.1.13) 
if a numerical representation of the second order count 
spectrum is desired. 

V.B. SECOND ORDER INTERVAL PROPERTIES OF THE SEMI-MARKOV 
GENERATED POINT PROCESS 

Let T be an nxn stochastic matrix with stationary 
vector as in (5.A.1.4). Each transition is recorded 
Sceereine CO its time of occurrence, wach times between 
transitions governed by F(u), the matrix of transition time 
densities. Let x represent the interval following the 
j-th event, with an arbitrary interval denoted either X 


or Xo Be. VeLt A Ss ene Lime to transition from stave 1 


k 
to state k in a single step. Let E (ute?) be the matrix 
eee heinements fOr Pr = 1,2,3,.".,h 


Demene to Ney Mavrices: 

G(u) = {t,,f,,(u)} represents a matrix of transition 
densities weighted by the Markov probability of the 
teansition; 

We = (6,543, represents a matrix of r-th transition 
moments weighted by the Markov probability of the transition. 
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The following results may now be established: 


Lemma V.B.1: Tne arbitrary interval, xX, is governed 


by the pdf 
f(u) = m'G(u)1 (5.B.1) 


where ] represents an n-vector of 1's. Thus f Cu) is a 
convex linear combination of the f.,(u)'s. 
Define i to be the limit as 3} 7 @ of TT, Then we 


have 


Lemma V.B.2: 


E[X] ; (92272) 


iI 

|= 
Eis 
—_— 
ll 


Var[X] T "(My -M, T oi yall (SB) 


From Lemmas V.B.1 and V.B.2 we have 


Theorem V.B.1: 


Cov(X, y= aM, (TIFT), j= 1,2,3,.--; 


(5.B.4) 


ety 


and 


Nef 





Theorem V.B.¢2: The spectral density of the interval 


process is 
iw -l 


-iw 


f.(w) = nT{M+H [Cle @-1)7*4+(1e 41) 71M, }1/0%° = (5.B.5) 


OF a oi 
t 


where 


of = Var[X]. 


Proof of Lemma V.B.1: Let v be the state of the 
process following an arbitrary event. Pr{v=i} = 7., where 
TT, MowGreen Clemeny Of nu. “ne probabilivy thav tae sexe 
Sevenu merks 2 Transition to state j is ts; Thus 
Pi ieoo,. fs = Tee. 

fe) ij? see ae 


MPCONnGl1Gional cdensivy is 


with conditicnal density 5,4). Tie 


nN 
Prwv=i1) 2 t,t, «Gu ) 


Cw) a a 
QO 1 j=l ij iJ 


I} 
i tS 


BE 


HI 


a G6(u)1. (5.B.6) 


This completes the proof of Lemma V.B.1. 


Prootpyo! Lemma 2: “The expectazion of % is finite since 
it may be no larger than max {us jt, which is finite by 
assumption. Thus interchange of order in the forma] 


definition using (5.B.6) yields 
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oO 


E[X] = ff uf (u)du 


0 
al n roe) 
= or Pee 5 uf, ; (u)du 
n n 
= oo joy asi 
- mM 1 , (5.B.7) 


which agrees with (5.B.2). 
Siler iy , 


E(X°] = mM , hence 


eee a 
var[X J = 7 {M-M, QO mM, IL : (5.3.6) 


Note that liom is aonxn matrix each row of which is identical 
with m'. Feller (1968, Ch. 15) shows that as j tends to 
mat iInity T? tends tola'’ = ios under the assumptions of 


mais chapter. Thus 
s 2 Bey ars a 0 
Var[X J] = a (Mo-M,T My )1 . 


This completes the proof of Lemma V.B.2. 


Broor of Theorem V¥.B.1: Sinee@} 1s a stationary 


J 


sequence, write for j > l 





_ St. ae i 2 
Cov(X, 5X44) = Cj) = ELXX, J-ECX] 


Applying the Chapman-kolmogorov forward equation (see for 


example Cox and Miller, 1965) the conditional expectation 


ar Soper is 
Et% X,|2,=s.. ]= : 63-1) ; c (525.9) 
ea Sk came Ae meee te ne 
i=l j= 
where ae represents the probability that the state of the 


system at step p 18S i given that the state at step O was 
k, i.e., the p-th stage transition probability. Note that 
TP = aa Chelmer, 1968, Chaves) . 


Ure Ondateoeine (5.8.9). 


1g @| 
RiGee. | = Ges Pr eae ) Eeex | See) 
or) ee ea sk oO J sk 
iQ! ig 18) ‘ | 
(j-1) 
= YT yee AE vere eG. pile 
eS aaa sk" sk ga, “1 pel a Supaly o 
= nM Too MT (5.B.10) 
Thus, 
(3) = aM Toot eM 1) 
: = "1 ya S 2 Mi= 
= mM (TIFT?) MT (5.B.11) 


a0) 





which corresponds to (558.4 )° 08 Pheorem V.B.1, thus 


Compretinge the proor of Theorem V.B.1. 


Proof of Theorem V.B.2: Where it exists, the interval 


spectral density is defined by 


f,(w) = {14(2/0°) = y(j)cos jwl/n, 
jak 
= {14(1/0%) 5 TM, (TP THT DH, (e te AY p/n, 
jizal: 
ONS sh oe (50429 
with is=/—-l . 
Let C(z) = I v(3)2° denote the serial covariance 
Ja co 
Penereting function. If = y(j) < —, then C(z) < o, 
eel 
O< |z| < 1. We first show that the covariance sequence is 
summable, and that lim C(z) = 2% y(j). Then, we show that 
sien ay Zril- ioe 
(le-~=T) Sxists Porg, 271.3 = 0,°1.22..... 


v 


The basis for the summability of the covariance sequence 
is from Kemeny and Snell (1960, p. 71). where it is shown 


bias There are constants b and r, 0 < r < 1, such that 


i ~ 7 ian A ieee: |) ee ee eo ee Oe 


(5.B.13) 


Combining (5.B.10), (5.B.11) and (5.B.15) yields 


al 





a a Be =) 
Iy(J)] = Bar 21 Sk" sk es “Sahel. “ities d 
nN nN nN afoul n 
S ty"s ye kM yoy pay ie at 
n j-1 
= Lb Eh ge See ee .  (5.B.14) 


Clearly, the right hand side of the inequality (5.B.14) 
is a term of a summable geometric series, hence y(j) is 
absolutely summable. 

From the Lebesque Convergence Theorem (Royden, 1963, 


peeeGes if @(x) is integrable. |PCx) | < g(x) and f(x) ee (oe) 


then ff (x) = iim ff (x). Identifying |y(j)| = eG)), 
fe.) ). = Min) (le lend and z = (BolyJ,id/n we have 
n n n 
See ee UA a7 - 
y v(j) = tim 2 Yt e = 7G.) (5.B.15) 
j=1 nee j=l 
; : —iw -l : 
It remains to show that (le =|) exists. 
If the determinant |Ix-T| = 0 then the inverse (Ix-T)7? 
4s not defined. However, |Ix-T| = 0 is the characteristic 


equation for the Markov chain described by T end there are 


at most n distinct roots. Since T is ergodic, x, = las a 


root, and for all other roots the inequality |x| < 1 holds 


=e 


(Feller, 1968, Ch. 16). Since |e = 15. and for 


Mee eel = Oftiste,...s Soo io el” 35 not a character- 


- 14) 1 


Mric value of 1 for 0 < w < 27, hence (ie ~“-T) exists. 
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Now, let z =e °° £for some 0 < m < 2m. Then from 
fo. 2. 11); 
en) = St (lM, le 
cree | ee 
j=l 
es iw -] ~©, -iw -1 
= nM, (Lett) AT (e781) ML, (5.8.16) 
anc 
f.(w) = {1+(1/0% )Pc(e**)+e(e*”) I} /m 


= (1tn7M[(1e7P-T) "P+ (Te 78-7) 4 TM, W/o} /r 


(ele ly) 


Equation (5.B.15) extends f,(w) to w = 0 and w = 27. 
eine (5.8.4), 


eal Lw 
Gus) ae) (M+, (le _ 


T)7*+(Le*-T) "7 JM, F1/(o%n), 
mien 1s rouation (5.8.5), thus completing the proof of 
maeorem V.B.2e. 

ines orm Of Ene Spectrum iS @nm amportant pert or this 
Mmeseerch. in particular, the form of the interval spectrum 
Of a semi-Markov generated point process is that of a mixed 
moving average-autoregressive process. The following 


theorem states this fact exnlicitly: 


5 





Theorem V.B.3: The spectral density (5.B.5) can be 


written as 


ys 
y a,cos j 
j J 


fi(w)=qet (5.B.18) 


S B,.cOs k 


0 


where Q, J, K, a Nia ee eerge) en acl By kK = ij2%<.58 Cepend on 


5 
i? Mo Me and On. the Size of the State space, n. 
Proot: Examine the iLeorm 


=i 
m'M,(Ix-T) M,1 = Z(x) . (5.B.19) 


mssuming «x is not a characteristic value of I, the inverse 
Besos, and Z2(x%) is @ sealer. Inverting (Ix-T) by the 
adjoint method (see for example Finkbeiner, 1956) the adjoint 
elements will be polynomials in x of degree n-1i or less. 


The determinant |Ix-T| is a polynomial of degree n, so 


(5.B.19) can be written 
Z(x) = {mM Aaj (1x-T)M,1}/|Ix-T| , (5.B.20) 


which is the ratio of (n-1l)th and n-th degree polynomials 


my xX, SO 





1 


(S28ec)) 


Now, 


a » a,b) cos(j-k) 


nN 
2 2 )? b,.b pcos(k-£)+ : b© 
k=0 2=k+1] * * j=0 9 


(5.B.22) 


pMbeseitucine (5.8.22) in (5.B.5) with suitable identifica- 
tion of terms results in (5.B.22) which is the spectrum 
of a finite mixed autoregressive-moving average process. 


foeerconoleGges Ghe proc: of Pheorern Vib. 4. 


V.C. EXTENSIONS TO HIGHER ORDER SPECTRA 


Defining the trivartence Tunction in @ naturaw way, lest 
Trviyey,Z) = BPAeEBS ayaa) } i 23rGZ) 


Then for the stationary sequence of synchronous intervals 


in a semi-Markov generated point process, we have 


Theorem V.C.1: TVA Xana 5 ok pa pay? = 7 (j.atk) 
SA ei Oe a ce 
jk 2 a as Org i. 





Proof: oince the process is stationary, 


E(X,, J = ELK L434 =u and 


wry hs, X 4 
re 


a ) = 1(3,5+k) 


rtjt+k 


BL(Xj-W) (X,-n) (Xj ypu) J 


ry Saal +X¥ ¥ 
ELX Xx. ] MELX OX AK, 


as *X Xs 4) ]42u7. Gee 


k 
Pregiee@ as an the proof of Theorem V.5.1, 


ae (5.0.3) 


ry y ¥ a j-d 
E[X ] 7 HiT MoT it 


ety Mevlce 4 


Subeuitutene (5.C.3) and €5.8.10) in (5.-C.2) yields (5.C.1). 


tits, COMDletes toe Drool! of Theorem V.C.1. 


Simnevar ly, 

a as a a aL aes joi =e 
(5,5) = 2 MCC Ty M277, (TIT?) IMSL (5.0.4) 
mG) = hee MMT [OM To OM SM =OM Tome 1. (5.6.5) 

Lua camer 1 re eet eee 

and 
- + i - CO _ CO 
(0,0) = wt CH. I (3M. 2M T Mi) J1 , (oo C abe 
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Rosenblatt and Van Ness (1966) list the following symmetries 


ia ene trivarizance function of 4 stationary process: 


Ge) SoG) a kad. (35027) 


which indicates that t(j,k) is completely specified by its 


values over any one of the following six sectors along with 


wine DOUNnGries : 


Secticn Tf: O<)] < k 
Seeceron if: Om < 4 
Secror Bit: i= 0 <k 
Sector IV; ae en ©: 
Spector V: |i ay ae 8 
Sector VI: <5 10 <4 ‘GomeGwese 


Define the bispectrum of intervals by 


b(w, 50.) =a 5 . t(j ,k)exp{-iw,j-iw sk} I/[4n*1(0,0)], 


jz-© kK=-© 


Som (5.0.9) 


=. W4 »W. 


In view of (5.C.8), (5.C.9) can be expressed in terms of 


eeecvor i values only: 


iL oH 





n° 3 -1((w, tu ) 
b(W, »Wo) = {i z Zz t(j ,J+k)Le 


jel kel 


\ e _ a 
)jtw5k) i((w, tw5)jtw 


2 ro 


1 


Coo the eho .j) 10 (WH. tieddehwead.)° =—Lekw. =f) 1 Giae—ku- } 
ae oe 2 +6 1 2 1 oe us O ren 1 2 


-iw 
™(0,j) Le 
ah 


j =<lweg 2 eect.) 
+ te 1" +e 1 @ it CO. 0) 


M4 8 


J 


tiw,j iwij -i€w.tw,)j 
Boji4))e 1 +e e +e 1 “e 1/7 (4net (0,0) (S26 <0) 
ih 


+ 


it ot 8 


J 


Wiememwe | Uate (5.0.10) im view Of (550.1), 95.6.5). (5<0.6) 


and (5.C.7), the following formulae will be useful. For a, 


b such that e “, e~° < 1 and not characteristic values of Ti 

Ey TOT Tg Ad OH = (le*-T) 77M, (1e?-T)7?, (See. aa) 
j=l k=l 

a i-b] 1,_b 1 

i eee et Cea) (eae. ( Heeere 2) 
j=1 k=1 

Meee ve OP = (6-3) eT), (5.0.13) 
j=l k=1 

co co pe ee _ _ 

Bae ee = Clee) Cle) -, (5.0.14) 
j=l k=l 

® _ a a : -, —aj=-0k Ps 
Let tT (a,b) = 2 Met i kt je Then from 


j= kell 
Mmc.1), (5.C.4) through (5.C.7) and (5.C.11) through 


m.C.14), 
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= (ARE m™M, ((Le*-T) "(Le P-T) 7 -T°M, [(eP=1) 7 (1e8-T) 


Pe) (le 1) 41 le <1) (leteT) + 


ie ae ea el - 


‘HL (5.0.15) 


Let 
= a aa 
mia) = JenQ.ie 
jae 
= mM, {{(1e*-T) T° (e%-1) 7 JM, 
a -l.©, @ = ba 
= eS a) FC) any) (Sec. 0) 
and 
* : a -, aj 
tO Ca) =e (Oe 


j=l 


T a -1 T co a -1 
T Mo (le =) My l-er MoT (le =—7 }) hi 


it 


7 a) a -1 \ ls ma a ogee 7 
TW {M7 Mie =e +2MsT MST Mile =1) ~} (5.6.173 


Merely. substituting (5-C.15), (5.C.16) and (5.C.17) 


ma (5.C.10) gives the result 
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¥ x x 
= , 4 P i ; ae = 
b(w,»w5) {tT (Cw, tw5)L,woi)tt ((w,tw5)i,w,i)+t ( wi, (w,+w,)4) 
Ld x * x 
i ,-(w,tw,)i)tt (-woi,w,i)+t (wi i,-w,1) 


x 
1 a (—W., 


: t((w, tw, )i)tt (-w,4)#t” (-woi)#1(0,0) 
x ; * 2 * : O 
a Ty (-(w, two )i)FT, (wii) tt, (wot) }/ Cn = (0.08) ) (5.6.16) 


The existence of b(w, »W5) is shown in a manner similar 
moo chat in the proof of Theorem V.B.2. 

IiM-eeneral, n-th order spectra are defined as Fourier 
transforms of functions of n-th order joint moments, fre- 
quently cumulants (see Brillanger, 19655, 1972; Tukey, 1959). 
The key step in determining the n-th order spectrum of any 


moment function is to observe that, that for this process, 


e cay (To 744 Poe TAM, Js =a ig ane eee 


(5.C.19) 


and 


7 Meee “MT. (Ee .20) 
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imaws the joint interval Structure is completely characterized 
ide mechs «OL Moose eo Mot, and T, with spectral representation 
Gepending on the choice of moment function. 

It may be observed at this point that the joint inter- 
val distributions are directly accessible. Referring to 
Lemma V.B.1, we see that the arbitrary interval density is 
a linear combination of the n° transition densities. Com- 
bining this idea with the construction of (5.C.19) gives 
the result 


> 28 }-1 k-1 
Pog yp (Uyrtaetg) = 7 G(u,) PF" G(u,)T G(u,)l , (Sacezas) 


where ie 5 yp (uevew) represents the joint density of the 
3 > cae 
intervals 0,j and jtk. This result can be generalized to 


any =cOmbination of intervals. 
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Via theo eho St Cent PONE ii AL. SUPER eOSLTION 
PROCESSES AS SEMI-i-ARROV GENERATED POLNT PROCESSES 

litiemcmanters Jit and IV; the mature of the spectral 
representation of Erlang and hyperexponential superposition 
processes was examined. The algebraic manipulations proved 
difficult and unweildy for all but the Simplest processes. 
In this chapter, the "method of stages" is exploited to 
derive semi-I‘arkov generated point processes which are 
equivalent with the Erlang and hyperexponential super- 
position processes. 

In addition to the computational savings resulting from 
the semi-larkov rervresentation, higher order spectral 
estimates become feasible. The development of higher order 
spectra is desireable because the various processes are not 
uniquely defined by second order spectra which @re indis- 
tinguishable from those of a stationary mixed autoregressive/ 
moving average process. Higher order joint moments are not, 
in general, available for the general superposition of iid 
renewal processes, but can be determined for the Erlang and 
hyperexponential superrositions by means of the semi-Markov 
modeling described below. In Section A the E(k,p) process 
is shown to have an equivalent semi-Markov generated point 
process representation. Independence beyond the first leg 
ds shown for the E(2,2) process, and computational considera- 


tions are discussed with regard to determining the matrices 


HZ 





T and E of Chapter V for the general E(k,p) process. 
State space reduction and compression receive special 
eveention. 

section B is devoted to the modeling of the H(k,p3q,A) 


process as a semi-Markov generated point process. 


VI.A. THE E(k,p) PROCESS AS A SEMI-MARKOV 
GENERATED POINT PROCESS 


-~AXx 


bette. = Katha. «otk Then Y 


L ee ee 
has the probability density function 


where Pr{X.>x] =e 


kJ] 


fy Cy) My eV /(x-1)! 


Yass 4) 


This well known fact that the sum of k exponentially 
Ctotiribired random variables nas the Erlang distribution 
is the key property which allows the modeling of an Erlang 
superposition process as a semi-Markov process. 

In the "method of stages" the random variable Y is 
MRougnht Of aS proceeding through k stages, the delay times 
independent and with identical exponential distributions 
over all stages. A realization of Y occurs upon termination 


Om the k-th stage. Y is said to be in stage 1 at t if 


) Re a a 2) 


ee qe 


and 


Lie 





Assume that p independent renewal processes with 
identical Erlang inter-event distributions are observed 
eoncurrentily. A state space can be defined in the 
following way: 

Designate each process as process i, i=l,...,p, and 
denote the current stage of process i by S;=1,...,k. Then 


define the state space 


c= {(s)5+++55,)} 
as the set of all combinations of stages. 

A transition occurs whenever a component process 
advances one stage and each component process cycles 
RMevpetitavyely through stages 1,...,K,1,..«.,K,l;..«. A renewal 
event occurs in process 1 whenever 1t makes the transition 
from s.=k to s.=l. 

a a 

Wote that in this formulation direct transitions are 

possible from S'=(Sy5+++585) to 8'=(Sy5-++555) Only it for 


Bote tal,..:,0 (S°te,) 8°, Where e, is a vector of 


mod ia 
Zeroes eycept for 4 one in the 1-th position. 

Piece lto ParGicular Formulation. transi ei10on tines are 
the same for all transitions. Because of the lack of memory 
meobersy O: the exponential distribution, if the system is 
meer ved! 4c any time; the time to the next stage in any 
Peocess has the residual life distribution R(t) = aoe 


The next transition is the minimum over the p processes of 


mae time to the next stare. Thus the time to the next 


Lad 





transition in the superposition process has the residual 
fife ci. Stribupi on R6P) (4) = ce Clearly, the process 
Which actually 2=dvances is process i with probability l1/p, 
since we assume that the component processes are identically 
distributed and independent. 

Example VI.A.1. The £(3,2) process. Let k=3 be the 
shape parameter of the Erlang renewal distribution, and let 
p=2 be the number of component processes. The state space 


acs 


Srl, 1) (1.2), (2,2) (22) 5.0322) .12530, 
(353) 32150143) (6.A.1) 


Figure VI.A.1 shows a network of possible paths of the 
Markov chain through the state space. When the process 
enters a state enclosed in a box, a component process event 
Secirs, and the process continues as from the circled state 
Stethe Same number. 

Recalling that the residence time in any state has 
residual life distribution 2 Gee observe that if 
the process is in state (1,1), there are two paths by which 
the process can leave and reenter that state without any 
intervening events. Since each branch from the state is 
meesen with probability 1/2, the probability thet a particular 
mach is chosen is a. where mis the teneth of the path. 
Thus the lower branch from (2) 196 Wid De realazed. With 


=o 
Peobability 2 ~. Given that a particular path is chosen, the 


LAS 








Figure VI.A.1 Transition network for the E(3,2) process. 
Times of transitions into states enclosed in boxes are 
Rmecorgeqa @S events in the point process. The transition 


Process continues from the circled state with the same 
index pair. 
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time until the next event is governed by the density 
y¥,(n,pA) = (pA) t™ “e /(n-1)! (6.9822) 


In this example, if the process is in state (1,1), the 
Probability that the next event is associated with a 


transition back™into state (1,1) is 
Priet. 1.) 4@e1)] = 20178) = 1/74, 


while the time until the next event, given that it represents 
a return to (1,1) is governed by ¥, (3,24) with expectation 
3/2r. The colon is used to denote a direct transition 
between the states indicated. 
We will return to this example on Several occasions to 
clarifty the development. 
VI.A.1. Reduced State Space, Sy 
oince the superposition process events are associated 
Sniy with certain transitions, it is deSireable to focus 
attention on a subSet of the State space. A new process may 
be defined which has as a state space those elements of S 
which correspond to at least one component process being in 
Stage one. 
Example VI.A.1 (continued). In the E(3,2) process, 


the reduced state space, denoted Sy takes the form 


ree a te eC) 5 C251) ,(3,1), Cage) 
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foes) (Gch i 1 )s “the path [ (1.2) -(1,2)7(2,2):(3,2):(2,2)] 
in Figure VI.A.1 would correspond to the transition 
[(1,1):(1,2)] in the reduced space, Ss. Trans2cion time 


would be governed by ¥, (4,24). Transition probability is 
Pill edo 613 2 Ja) = N/2" : 


where N=3 is the number of paths in S starting in state 
(1,1) and terminating with an event in state (1,2), having 
no intervening events. 

Continuing with tne general presentation, there are 
two advanteses to the use of the reduced state space, Sy: 
First, the cardinality of S is [S|=kP?. Although |S_| grows 
Paebaly with kK ana ©, 10 1S much smelje>. An expression for 
He.nOc Given because it 2S rather complicated, and che 
next step in the state space reduction process renders if 
unnecessary. The main value of state Spvace reduction is 
mies 11 the transition vattern in the reduced State space 
has retained the Markcv property, then by considering the 


transition times in S_ as events in a point process, we have 


J 


mars 
. 


ay) 


é 


d point process 4S defined in Chapter 


a Semi-Markov generat 
Clearly, the Markov property is retained cvhrouch the 
reduction process. That is, the trarnsiticn probabilities 


associated with any state s in S. are independent of the 


i 


exOolution of theristate space prior to entering s. 
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oe hee. Viransicion Probabilities in S. 


Examine the direct transition in = from 


we=(S)5+++58)) to w'=(S}5+++58$_j51). This transition 
corresponds to a path in §S 
= : , : eS 
v es (Syoee es Si )rreei(Syy--- 854k) i CS],---58)_451) =v : 
(6.A.2.1) 

with all intervening states ve, 1=1,.:+,F-1, Satistyine the 
inequality 

a (6.8.2.2) 


where it is understood that the inequality holds for each 

element of the vectors. The inequality condition (6.A.2.2) 

precludes an intervening event in the path (6.A.2.1). 
mecall @aat in S, the ehoice of the state follow, 


any initial state is an event of probability 1/p. The 


number of transitions from v" to jon is 
p-l 
rai = 2 (s'-s.) + (k-s ) (6.8.2, 3) 


(The process p was chosen arbitrarily as the source of the 
event. Any other process vould have the same property, but 
would be more cumbersome notationally.) The number of paths 
Mops savisfying (6.A.2.1) and (6.4.2.2) is given by the 


multinomial coefficient 


L49 





ee ee (64k 234) 


p 
{ 


J 


lot 
pou 


; (si-sj)t}(k-s,)! 


Comeinine (6.2.2.3) end (6.4.2.4). and noting thet 


1G 


Priv ty] = 1/p gives 


Pr{u®:u’] = N/p* . C6, 8.245) 


Mime her. Che transition time asseciated with this event 2s 


governed by 


Pye syr ft) = ¥,(r,pa) (6. Rses0) 
since (u’:u’) represents r realizations of iid exponential 
(pA) random veriables. 

Example VI.A.1 (continued). In the reduced state 
space, Sa associated with the E(k,p) process, the matrices 
of transition probabilities and transition time densities 
can be developed using (6.4.2.5) and (6.A.2.6). These 
Matrices are shown in Figure VI.A.e and Figure VI1.A.3 
respectively. 

Vis. cobiewGOlLansotdwoLare .oDeCce., Sa 

Study of Figures VI.A.1, VI.A.2 and VI.A.3 reveals 
@ degree of symmetry which suggests a further reduction in 
Bhe size of the state space. In particular, it is possible 


CO treat all permutations of a set of permissible stare 


ow) 





(11) (are) (21) (13) cei) 


(1) t is i i i 
(12) = i 5 "3 “ 
» |  & #& & 
om |} © & 4% 3 
m |b 2 6 & 3 


Pigure VI.A.2 Transition matrix for the E(3,2) process; 
Reduced state svace (S27 


The states are denoted (ij). <A matrix element is the 
BeoObebdi lity tne next “boyea” state (See Fig. VI.A.1) 
entered is (ij) given the previous "boxed" state is (kn). 





1) 


(12) 


(21) 


13) 


1) 


‘he 


Y, (352A) 


Y, (2,24) 


¥,(1,2A) 


y, (1,24) 


(12) 


y, (352A) 


Y, (352A) 


Y¥,_ (252A) 


(21) 


y, (452A) 


y, (352A) 


Y, (332A) 


y, (22d) 


(13) 


¥, (5524) 


y, (452A) 


y, (4,24) 


y, (352A) 


Y, (3,24) 


(31) 


y, (5524) 


y, (4,24) 


(3,24) 


Y, (3,24) 


Figure VI.A.3 Transition time densities for the E(3,2) 
Process; reducea state space (32) 


jne state representation is as in Fig. 


NEgPowd. 


Given that 


the system has just entered state (kn) and the next "boxed" 


Seace (Fie. VIi.Av)) is (13); tne time of transition will be 


governed by the Erlang density indicated. 
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values as a Single state denoted by a generic element. 
Thus w={(s),.--58,)} would represent all states of S_ which 
are distinct permutations of the elements of w. The collapsed 
state space is So» Line DartlClLen -O1 Sy defined by the sets wW, 
The states of So will be denoted by lower case script letters 
indicating their roles as sets of states from Sa States 
of Sy aed (Still oe referred (C6 -41n vector noraci1on as 
underlined lower case letters. 

ineevemple Vi-As1, S.={ 151-5 1.2 , 153 iz 


Tae caraginality or >. is given by 
<2 kt+p-e2 2 
IS. =( ool ) 9 Coe es) 


the figurete number for k types of elements taken in sets 
of size p-l. Figure VI.A.4 compares [S| with IS for ik tend 
Pevating values 2 through 5. 

To be useful in view of the results of Chapter V, 
transitions within the collapsed state space, Sa: must 
eyntbit the Markov property. That is, it is necessary to 
show that S.. hotel tS. Leas i >On DrObabliaty maprix, ee 
is a lumpable Markov chain with respect to the partition So: 

Following Kemeny and Snell (1960, Ch. 4), a Markov 
BiaineeC, £5 Said to be  Jumpable with respect to a partition 
Sati a - 34, if for every starting vector 1, the lumped 
Process is aifarkov chain with transition probabilities 
independent of me A mMe@cessary end “suriicient. condition thay 


© be lumpable with respect to the partition A is that for 
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k 
2 4 8 16 32 
3 9 27 81 243 
r 16 64 256 1024 
5 25 125 625 3125 
Table of |S! = kP 

p 2 3 4 5 
2 2 3 \ 5 
5 S 6 10 15 
4 U 10 20 Se 
2 2 15 a2 70 


Gay 8 peed 
Tape <a Say) oe k-1 


Figure VI.A.4 Comparison of state space size for the E(k,p) 
Pépresentations S and S.. Tne dimension of the stage 
transition Markov chain“is IS| = KP. The dimension of the 
reduced, collapsed state space is Cy) 
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ewery pair 9of sets A,, Aw, Drin:A/} = 2 Prin:m} has the 
a J J meA 
same value for every state n centained invA, « These common 


values, {t,.}, form the transition matrix for the lumped 


ay 
chain, A. 
Formally, we state 
Theorem VI.A.1: The Markov chain S,. is lumpable 


with respect to the partition Sa: 


EPreoor: it 3s Sufficient to show thar 
Prlu=(sj5+.+,S,)iwe{sj,-.-,sp}] = constant 


for ue{(sj,-..,5,)}. 

Pirst, let u and W be generic names of elements of 
S. emi@m@assume that a direct transition from u to Ww is 
measible in S,: That is, there exist elements u and W ath algae 
end @ ane a path in S, CUrV bees SV, EW) satisfying the 
inequality (6.A.2.2). Further, suppose process m is that 
Beocess (which records an event in the transition from u to 


w. Then the number of steps from u to w is given by 


Mo ei.223) as 


p 
st - E os,tl , (6.4.3.2) 


Since Sn DY COmstruction.. Whus, wae number of transitions 





in S corresponding to a transition from an element of u to 
an element of w is independent of the elements chcsen. 
Hence, 


Pr[u,:w] = NED, A = 2... sm, (6.4.3.3) 


where No iseene number Of distinct paths im S Satistyine 
Mee eee .e) beginning at Us and terminating at an element of 
Peeenere. 1 represents the number of distinct permutations 
of the elements of u. 


Let Ne be the number of paths from u., € u GO 


J 
w. € W, where again process m has recorded the transition 


event. Then 


N.. = (n=l)! = 1,...,¢; 4 = l,...5n 
a { 7 (si-s,)!}(k-s_)! 
jm Jood * (6 .i 344) 
and 
t 
eo (Gigh 3 5) 
al jel a 


where t is the number of distinct permutations of w. 


x % % 
Wet us (S.5..+,8.) be any other element of i. 
=i al p 

Then there exists a one to one mapping, h, of u,, onto a, 
x : x ¥ 
such that h(s,) = s,. Then a new element ee (S}5.++55)) 

¥ x 

al iy ! = r . ; - hh - = i 
‘ ormed from h(s} S| Lt follows that Nay Nyy and 

Ny = Ny = N(u,w). Hence the lumpability condition is 


meceisfied, thus completing.the proof of Thecrem VI.A.1. 





Tneriianctotons prebpabpllity matrix for the collapsed 


state space 1s 


aor 
HH 


{Prfu:w]lu,wes |} 


eo Pawel | ese} | (Oman eso) 
weWw - 


The transition time density matrix is 

Ett) = fy, (¥(u,w) ,pr) [u,wes } C628 3a 7) 
hevLumaine Yonce more to Example VL.A.1, Figures VI.A.5 and 
VI.A.6 show the matrices of transition probabilities and 
trayscitiloOn Gensities, extracted from Figures VI.A.ée and 


VI.A.3. For example, 


oeeeeee ys 4.2) } = Pei ti.g2): (2,2) + Pri tise). (2,8) 


iH 


3/8 
Wik. 3.8. + PrOO! of PMaeorem JIL. 4.2 
Theorem JII.A.e claimed the interval spectral 
density of an E(k,p) process is expressible as the ratio of 
finite, rational polynomials in cos w. Theorem V.B.3 showed 
the same result for the interval spectral density of a 
univariate semi-lMarkov prenerated point process. In this 


Section it has been shown that an E(k,p) process has an 


Sy) 





as tke 11-33 


{11} - 2 2 

as 5 3 
tet 7 B B 
a 


Transition matrix for the E(3,2) process; 


Figure VI.A 
state space (S,). 


3 

* 
eolijapsed sta 
The states are denoted {ij} to indicate their functions as 
Sets of states in S,. That is {ig} = {1(423),(ji)}. As in 
tions represent movement retween 


a ome 
"poxed" states in Fig. VI.A.1. 
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{11} ta) ede} 


Olgas ¥,(3,2A) ¥, (452A) ¥, (5,22) 
12} y¥,(2,2A) ¥, (3,24) Veter) 
{21} ia ea) Vee 2A.) ¥,(3,2A) 


Figure VI.A.6 Transition time densities for the E(3,2) 
process; collapsed state space (S.). 


State space representation as in Fig. VI.A.5. 
Interpretations of entries as in Fig. VI.A.3. 


oe 





equivalent representation as a semi-Markov generated point 
Processes tnus eCstablashine Theorem 211-A.2°as a Special 
case of Theorem V.B.3. 


VI.A.4. The E(2,2) Process as a Semi-Markov Generated 


Poing Frocess 

Let N,(t), i = 1,2 be a point process with indepen- 
dent identically distributed intervals governed by the 
¥, (25%) density. Let N(t) = N,(t) + No(t) denote an E(2,2) 
counting process. N,(t) may be thought of as a Poisson 
process in which only alternate events are recorded. Con- 
sider the process N,(t) to be in stage one if its next 
event Will not be recorded, and stage two otherwise. Events 
in the superposed process, N(t), will occur whenever either 
contributing process makes a transition from stage two to 
stage one. 


Define the states of the semi-Markov process by 


(i,j) = tN, (t) is in stage i: No(t) is in stage j}, 


ares : eos 


so that the entire state space is 


See Pt sd (hee el eee 2 


ASSUMe Goat At Some tine the process 1S in state 


(1,jJ). Let V. and V. be the times to the next transition 


al 2 


in processes 1 and 2 respectively. Then, by hypothesis, 
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Vy and V5 are lid obeying the exponential probability law 
with rate A. Component process 1 will advance before com- 


ponent 2 if V, < V5, an event of probability 1/2. The 


iL 
time until the next transition will be V = min{V, ,V5} 
which is distributed exponentially at rate 2d. 
Transitions within the chain S follow the pattern 
Maiuctrared ie fig, VI.A.,7/. From any state, one of two 
eactns will be chosen with equal probability. Transitions 
to the left result in events of N(t). The possible tra- 
vectories from each state terminating in a m@in process 


event are enumerated in Fig. VI.A.8. 


The reduced state space of the E(2,2) process is 


Coe Gian), Gre enone 


mae transition, matrix for the recucedc State space may be 


femivec: trom fie. ViZA.8.. For example. 


Peltraj,eevony 1] + Pritrajectory 2] 


Paeeeie ds. is 1) | 


= Ae. 


Bimilarly, the matrix of transition time densities may be 


maken from the table of Fig. VI.A.8. Figure VI.A.9 lists 


Mier creansition Pprobabllitvy and interval density matrices. 


ieee 








Eeeure JI.A.7 Transition network for the E(2.2) process. 


Beansscions to the left result in events recorded in the 


Meine process.  Transiticns to the rignt do not have 
eerresponding events. 
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No. Trajectory Propabllity DLS Tri bUL rom 
1 (11): (12):(11) i 14 (2520) 
2 Gla C2 1 eee 1) = ¥, (252d) 
3 (11): (12) :(22) : (12) = ¥4(3522) 
4 (11): (12): (22): (21) = 14 (352A) 
5 (11): (21): (22): (12) = ¥, (352d) 
6 (11): (21): (22):(21) = ¥4 (352A) 
7 Gi C19) 5 ¥4(1,2A) 
8 (21):(211) - ¥_ (1,22) 
9 (12) (22): (12) i V4 (2,22) 
10 C2 (22) (2) 7 ¥, (2,24) 
ikl Clg Fr Gz.25 aa alle) 7 ¥, (2,22) 
12 (21) :(22): (21) t ¥_ (232A) 
13 (22): (12) - v4 (152A) 
14 (22): (21) - ¥, (152%) 


Figure VI.A.8 tape transition trajectories in the E(2,2) 
Peocess. This is an enumeration of all trajectcries from 
may State in the Stage transition system, 8S, terminating 
mith an event in the point process (a transition to the left 
moierig. VWi.A.7). The probability and distrpbution columns 
ere conditioned on knowledre ot the “*tInittal statc. 
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Cala Ci) C21) 


a1) : : : 
(12) 4 7 2 
(21) 5 7 r 
Transition Matrix 
(ig) 
(1p) (12) (21) 

(11) Wetec!) ¥,€3 ,2A) Nek sen) 
Giz} % 13e)) ¥, (2 52h) ¥,(2 52h) 
(21) ly. (1 52a) ¥, (2 52A) y,(2 524) 


Transicion. Time Densities 


Figure VI.A.9 Reduced state space (S,.) lavrices for the 
Pee,2) process. 


Interpretations of these matrices are as in Figures VI.A.2 
ama VI.A.3. 
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Finally, lumping states (2,1) and (1,2) forms the 


collapsed stave space 
S. aot beat lee 
Wace eeransi CON matrix 
Wee ie 
le lie 
aac ahneerval density matrix 


YAR.) +, (3529) 
F(t) = 


¥,(1,2a) Y, (2,20) 


CWearily, the stationary vector of | is 


m = (1/2, 1/2) 


From Lemma V.B.1, the density of an arbitrary 


macverval is 


i 


fit) mee) ) 


Hh 
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Cy, (1,2)427,(2,2)47, (3,2) 1/4. 


(Gta, 1) 


(6,8,4.2) 


C68 439 


(6.4 2) 


(6 eee 





Hn Chapter VII, this result is shown to be the same as that 
derived from the exvression for the density of an arbitrary 
superposition interval. 

Lewis, et al (1973) showed that for the E(2,2) 
process, the serial interval covariance vanished for lags 
greater than one. The semi-Markov representation admits 


the following 


Theorem VI.A.2: Let A be the n-th interval in an 
B@@meyeorecess, 1 = 0,21,22,.... Then Ry is independent 


of all realizations — j <n-1l. That is to say 


x = % 


be = 
Pr{X<t |X, = tos n-3 33° 


ee Oe), 


Proof: The interval a 5 


of one of the component processes from stage 2 to stage l 


Was Germinetea by the transivion 


MPieoine the system in state (1,1), (1,2) or (2,1). Sini- 
laeily, the interval A will tegin with the system in state 
Mielec <2) or (2.1), 2.e.;, States {1,1) or {1,2) ef S.: 


Assuming x tevramated by 2 transition to (1,1); (€6.A.4.2) 


-2 
shows that states f.,1} or {1,2} are equally likely for the 
commencement of interval Ae Thais 1S also the case for 
XD Perminativesby entry inte states (1,2) or (2,1). Thus 
Information regarding the state of the system derived from 


the interval] Xn? provides no information regarding the 


Brete Of the syst@m at the outset of ae hence 4, and Ano 
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are independent. Similarly, all knowledge of the system 


Gerived from knowledge of the events X-2? X Sheds 


n-3?°°°? 
MOet2 ee On the dastribution of ae 
This completes the proof of Theorem VI.A.2. 
To show that a first lag dependence exists, it is 
sufficient to establish that cov(X.,X,) 7 0. To use Theorem 
V¥V.B.1 which formulates the serial covariance of a Semi- 
Markov generated point process, it is necessary to determine 
therematrix of welehted first moments, M,- Let U be a random 
variable with density Y¥, Uk5,A). Then E[U] = k/A and 
E(US] = k(kt1)/A°. 


Mins . Wier (Oo. 2? aeemde COen. ty 3) 


V7 2 3/4 
M = 
1/4 1/2 
Conventionally, T° = I, and in this process 
eeu 
SO 
Pana ee 
cov(X 5X,) = mW, CI-T )Mi1 


a 


I 


-1/16 > 
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The first serial correlation of this process is 


piven by 


Pp, = cov(X 5X, )/Var(X,) 


Lemma V.B.2 gives the variance of the process. 


The matrix of second moments is (from (6.A.4.2) and 


(oh 4. 3) ) 
7 le Vie ea 
M., = 3 
og ie 6 
50 
Var(X.) = m'(Mj-M, TM, )1 
ae eae ae 
and 
P, = 710: ., 


which is the result of Lawrence (1973) as well as Lewis, et 


al (1973). Note that while Lawrence fave the result that 
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Ba = -1/10 for this process, we have eStablished the stronger 
result of Theorem VI.A.1. 
Theorem V.B.2 gives the spectral representation of 


tne process. Computing first 


x-1/2 a7 2 


Ole aes = Lye x-1/2 
x(x-1) 


then, taking i = /-1, 


ph?) (a) (eGnGige Sane -°/te 13 (peewee es 


(5-cos w)/5 


which is the form presented vty Lewis, et al (1973). There 
Peeves cerived by the method outlined in Chapter III, 


Section A (above). 


Nittieeo. JWeverrineabt On Of |, and Me ror the Collapsed 


E(k,p) Semi-Markov Process 
Pie wereund WOR fOr devermining the transition 
matrix, 7, of the collapsed state space, Sos was established 
in Subsections VI.A.2 and VI.A.3. Equations (6.A.2.3), 
Moc. 2.4) and (6.4.2.5) @ave the one stage transition in 
the reduced state space, Su to be a modified multinomial 


mendom variable for states satisfying the relation (6.A.2-.2). 
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The lumpability condition of Subsection VI.A.3 
states that the sum ofthedirect transition probabilities in 
S, from an element of a state set (C3, 5+++5d,)} E S, to 
each of the elements in Ujps++-sd 0d} gives the collapsed 
Beacemalrectc transition probability. in general, then, the 


method for determining Pret{(jqo-+- sd dbl ys--- 55033 


ul 
is to enumerate the elements of {(3ys+++d5)3 = {vi +++ oVo}; 
select a particular element u ¢ {(5y5+++55,)3 and evaluate 


Korres) for al) pairs (usy,), summing the results. 


i 

The process outlined is cumbersome, although easier 
to implement than many of the computations associated with 
superposition processes. While there may be aS many as Dp 
elements in a collavsed state set, this will only occur when 
Bae indices contained in a typical element of the set are 
all distinct. Generally, Several component processes wil 
Death -Gne Sarre stage, resulting in a multiplicity of indices 
in the collapsed state set. 

Prample Vi~h.2: Teens. t2.0r PrCbab. Lees 2 zn 
E(5,2) Process. In the collapsed state space of the E(5,2) 
Buecess, what is Pri{i1,1,2,2,2}:11,1,1,2,3) )? Although 
there are 20 elements of {1,1,1,2,3}, only six satisfy the 
condition (6.A.2.2) with respect to the generic element 
(1,1,2,2,2). The condition is violated in all cases in 
which more than one component process must enter stage l. 


For example 
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Pein inet) (1.2. 3.1,1)) = 0. 


Bimenem. each Of the six attainabie states will be chosen 


with equal probability, since for example 
PG eee eC ele 3) | = Pelt tet 22 ce). sd Se end) | 
tausemusime (6.0.2.3), (6.4.2.4) and (6.4.2.5), 
Belt ede oh 162 as = ys 


Continuing the general development, we examine the 
moments of the process. Determination of the Me matrices 
fa DYDroduct of the | computation. In Chapter V., the 
Macrix EL = (537) Was defined as The mavrix of S-th 


memenvs Of the random variables, 5 of a semi-Markov 


ij’ 
process. In a semi-Markov process corresponding, to an 

E(k,p) process, the distribution of S55 is totally determined 
me une rate A, and the number of state transitions, r, from 
state 1 to state j given by (6.A.2.3), where i and j are 


indices assigned two of the state sets of aac 


DPpwismconvenlent @t this junccure to establish 


Lemma VI.A.1: Let X be @ non-negative random 


perlable with probability density function ¥, (7,4). Then 


ie 





-k-1 


Ee@= wel yal) } 


7A rte) ELXE], k = 0,152,... (6.A.5.1) 


Proot: Formally operating on the definition of expectation 


Sieenabrlais GiserabuLred random variable 


+ am ~ 
erxk Ly ae (xk 1) ,r Fons | AX ae 
O 

2. GEES! Neca ri yrtk-1 xe ao dx 
r-1)! “ (rtk)! 

= Geen yok) 
r-1)! 

=), - (rth EX]. 


Taking ery?) = 1, so that E[X] = r/dA, completes the proof. 
Returning to the computation of Mes assign an index 

Wee lee. tO each state Set of ae Denote by Pas the 

momoct Ol Stages Separating the states of 1 and j, where 


Tas hs fivem by (69/A.2.3). Then 


st] 


rr 
I 


st] (Cr, ts)t/ Cr, j-1)ty/a 


; (s) 
((ry ts) uy, }/ | (Gods 52.) 


te 





and 


: (s) 
aves = {ty ,(rysts)uy, eae COn io oe 
In particular, 
MS = {ts sry4}/r (6.8.5.4) 
and 
am 2 
M, = {tp 5ry,(rygtlisa : (6.4.5.5) 


The results of the computation proposed in this section and 
applied to selected E(k,p) processes are summarized in 


Appendix C. 


VI.B. A SEMI-MARXOV GENERATED POINT PROCESS MODEL OF 
WHE Hesse, &) PROCESS 


ar 


Pollowange the procedure of Section A, let Y = X. with 
probability oe foe een oue Wile ie - is ™moOverned by the 


survivor function R(x) = exp{-h, xt. Then Y has the 

kK 
hyperexponential survivor distribution R(y) = f£ eNO a a 
Jak ; 
: i 


ch the 


o il 
= 


Let Ny (t) represent a counting process in 
times between events are iid random variables governed by 
R(y). Then Nj (t) iswoota te be Gn seoee j 1f the time to 
the next event in the process has the survivor distribution 


By ty). 
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ter n(e) = N,(t) a eee N ft). The state of the process 
N(t) is the vector (Up aseeaV,) where V taking on values 
i,...,Kk corresponds to the stage of component process j. 

An event occurs in the process N(t) whenever an event occurs 
in a component process. The state of N(t) will change only 
in that element corresponding to the component process 
responsible for the event, and then only if the component 
process enters a new stage. 

The time between events in the Superposed process N(t) 
will be the minimum of S,(v.), 1 = Ljas45Ps Were S.(v,) 
ieee. etme CO the next event In process i Liven that iat is 
Currently in stage Vi. Because of the lack of memory 
property of the exponential distribdution, there is no need 
POrweoncern with regard to forward recurrence time in this 
POormuilatilon. 

The probadility that component process m is responsible 


for the nex@ event in N(t) is 


Pr[S_(v) = min, {S,(v,)}] 


p 
Malt Gee : (Oma 


which is indevendent of all history except the current 
State of the system. Here Cu) is the parameter of the 


Peponential distridutionw@eoverning a process jJ in stage ie 
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Thus, a semi-Markov process has been constructed which 


represents the superposition of p iid hyperexponential 


Renewal processes. Transition from state v = (Vy asses a Uy) 
pov! = On Ua is POssible Only if vy and’ v' digier in 
at most one element. Let m be the index corresponding to 
mae Clement of v" which diifers from Vee EMiol=) or mae eS ve J 
aaa Vo = "5 
Aides 
Prtv:iv'] = a eer a) (6.8.2) 
gee ewe, 
f= 


mat 2S, the probability of transition from v to vy" is the 

Brebeabljaty that the next event iS from process m, and that 

process m enters stage j' following the event. 
Moieeprobability that the system returns to 20s original 


State 1S given by 


TI ae la 


av, avy) 
se (Gabi 3) 


ly 


Prt[v:v]J = 


| ie ae ae 


at 
Example VI.B.1: The H{2,3;q¢,A) Paocess. With k = 2 and 


Bp = 3, the survivor function is 


-At -A’_t¢ 
R(t) = q,e 


and the state space is 





= eles elipe le) Clic i leans (2, lee) (doe. 2) 4. G2 yd.52) ; 
(2m) tee se) 


Figure VI.B.1 shows the network of possible transitions. 


rr me 


Eien ec 


The sojourn times in each state are the minimums of 
exponential random variables, hence are themselves exponen- 
tial. The mean time in state (i1,j,2) is Cd. it d i Ap) 
Morel sj, = 1,2; where it is understood that the sojourn 
time is considered to be the time between events regardless 
of the state entered following an event. Transition 
BrOpeollities, shown in Fig, VI.B.2 are computed from 
MO Bis 3). 

Wiebe. l.- The Collapsed Stave Space, So 

Examination of Figures VI.B.1 and VI.B.2 suggest 
a collapsed state space might be appropriate to this 
problem. Let u = {Cu 5++-,¥,)) be an element in the 
cOllapsed state space, Sac Here u Will represent all 
mevors vy ¢ S for which u. elements of v have the value: ji, 


/m- 1,...,k. In Example VI.B.1, the following correspondence 


eopDlies: 


It 


eae see ev = (1a) 


1 


PoP RGwe ers) GanCiec a2) ecoemte. 2), (2,2 1) 
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Figure VI.B.1 Transition 
Baean H(2,33;¢,A) process. 


In this system, all stage 
m™. tne point process. In 
marect transitions from a 
point process event. 


network for the stage transitions 


transitions are recorded as events 
SdchU1On, Levis possizpre to Nave 
State to itself, resulting in a 


alee 
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poet iieaey = (ll 21 2,1) C2, 1.2) 

Hea 10, 3s = (22,2) 
Mmormad dey’, 

S ((uj5-++sUy,)lusef0,...,p},2u.=p}. (Ope cis) 


Maes cardinality or So is the same as the number of distinct 
mevseot K ODjJECtS taker in Broups Of Sige p, i.e@., the 


figurate number 


Isj) =e (RPBOT) 
@ p + 

This compares favorably with the cardinality of S, |S | = we 
For example, if k = 5, and p = 3 then [S| = 125 while 
IS] = 35. 

hus. VECtOrs UW," Aan = are said to be adjacent if 
k k 
BE |ju,-u!| < 2 and £ (u,-u!) = 0. Adjacent states in S 
j=1 J J _ J J J C 
Mave corresponcing states in S$ which differ in at most one 


euerment, hence direct transitions in 2 are DOSsiDle Only 
between adjacent states. 

Mo estaolish that the Markov proverty may be ascravec 
to See recall trom Seetion VIA, 3 that it is sufficient 
that oF Pabe@eGeo1s S 1 Such Gaia wear for each vy in 


S represented by u in Sa. 


ig 





Prieta = Priviv'] = constant 
“vieu! 
For definiteness, assume that a transition from u to u'! 
fesuics, from a@ COmpOnent process in stage 1 transiting to 
stage j. Inu, there are u; processes in stage i, and the 


probability that one of these processes generates the next 


event is 


which corresponds to summing the expression (6.B.1.1) for 

the probability that a particular process is responsible for 
the next event over all processes in stage i. The probability 
that the chosen process will enter stage j is ds» leading 

to 


Priag<' | =U, A<0./ ud CO abel.) 


cea 

irrrespective of the state of 5 chosen to represent u. 
Continuing the Example VI.B.1, the transition 

Stee x oF theecollapsed H(2,33;qsA). process is shown in 


mur, VI.B. 3. 


VI.E.2. Expectation Matrices for the H(k,p,q,A) 
SeMmi—harkov Ee CCcecs 


As observed above, the sojourn time in a state 


usr, independent 


lmMny 


ue =e is exponential with parameter at = 


= 
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a OS Se ee 
oN mea 
ehody 
ee : 142 5 
tio 
03 0 0 


mene VE. 3 
collapsed state space, 


12 


2449, 7505 


ate 


a 


03 





Mgaasi, tomelatrix for the H 2.340 ,.,) process ; 


Maeestatesnin. this.process.are dencted {i]} to indicate 


bhieirtirole as partitioning sets of the state space, Ss. 
(ene) Gea C2 ad ys 


{2 = 


example, 
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For 


2) = (Ge). (212). (22. 





of the subsequent state. By Lemma VI.A.1, if X has proba- 


mrlitcy density function f(t) = ee = y, (1,4), then 


Die | =6n/r , k = 0.1.2... (6.B.1.3) 


Indexing the sets of S, on the positive integers 
so that o5 is the parameter of the exponential sojourn time 


Srstriguctron in state Us s Ieee a be the matrix of expectations 
Ee) 
193 

transition to state j. Then 


LU Om So,;Ourn time in State 41 conditioned. Ubon 4 direct 


yt) = r!/@., if (l- a0)acent 7); 
aie 1 


and is not defined but may be taken to be O otherwise. 
The matrix Me of weighted moments is 
(r) 


ie = {us tis} 


where the transition matrix of the collapsed process is 


Va es 


at 


Toys Metonod 15 WseEed in ection VILL. B.1 to penerete 
mumerical spectral representations for the E(2,2;q,A) 


erocess. 
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Vai Ste DENS hi On ARB A eerie RY AN 
THE SUPERPOSITICN OF RENEWAL PROCESSES 

Tne Ppreopabailasty density function of an arbitrary interval 
in a superposition point process can provide some initial 
information regarding the component processes. This chapter 
Syamenes the pdt of an arbitrary Superposition interval as 
epiumescion Of the component interval probability density 
Hunet eon. Although the material presented is not new, it 
is given here to provide an added characterization of the 
Erlang and hyperexponential processes. 

In Section A, a general component process interval pdf 
1s assumed, and the form of the marginal superposition 
density is determined. It is shown that the initial value 
eleume Gens .ty 1s 4 function oO: the number of component 
processes. 

Sections B and GC apply the results of Section A to the 
Meso wand Hik,psa,A) processes, respectively. 

Piers A.. THE ARBITRARY LITERVAL DENSITY IN THE SUPERPOSITION 
OF RENEWAL PROCESSES 

The, purpose Of this Section is to derive heuristically 
the probability density function of an arbitrary interval 
in the superposition of p iid renewal processes. This 
Mesult was originally given by Cox and Smith (1954). Let 
R(t) = Pr{%>t} be the survivor function of the intervals of 


of the component renewal processes, with associated pdf f(t). 
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Then the equilibrium excess distribution (forward recur- 


rence time distribution) is (Cox and Lewis, 1966) 


Z(t) = lim Pr{time to next event>tlevent at u} 
U-+—00 
ive) 
= (Efx])7+ sf R(v)av 
G 


The leneth or an arbitrary interval in the super- 
position process is the minimum of the time to the next 
evemewan Ceci OL GGne p component processes. ihat is, if 
x (P) @enaeces an erbitrery interval of the superposition 


process, 


p 
RP) ety = Pr(xsPeoty = oT 


Pel toot) 
j J 


1 


where i is the time to the next event in the j-th component 
process. 
[Meters oe. che indexsor the component responsible Tor the 


most recent event. Then 


Reo =o 
Eel aca = 
(2 cy A 1s a 


SO, 


RSP) (4) = R(t)zZP71(¢) (7.A.1) 
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The intervals of the component processes have pdf 
_ _ OR 


so the pdf of an arbitrary superposition interval is 


gp iP? 


p'P) (4) == Ae (t) 


R“(t) yyP-2 


LeCCoACt) + (p=) IX] Ct) 4 (Fen. 2) 


The anitpwvel point of the arbitrary interval density is 
ellosely related to the number of component processes, as can 
be seen from the following 

‘Theorem VII.A.1: Let f(t) and e6P) (4) be as defined in 


Piisesection. Then 

cP) (0+) = (0+) + (p-L)/EIX] (7.8.3) 
and in particular, when f(0+) = 0 and etx 'P? 3 = 1, then 

e'P) (ot) = (p-1)/p_ (TAN) 
Proof: From the definition of Z(t) as the survivor function 
of a non-negative random variable it is clear that Z(0) = 1. 


Since R(t) is also the survivor function of a non-negative 


maadomevariable, R(0) = 2. Thus, in (7.A.2), 


EOS 





rim f'P)(t) = £(OF) + (p-1)/E[X] 

tO 

For a stationary process, ery P) 3 = ey SOE 
erx'P? 3 
ery 'P? 5 


1, then E[X] = p. Hence for f(0+) = 0, and 


1 


1, 
e§P) (94) = (p-1)/p 
This completes the proof of Theorem VII.A.1. 
Tine final form of this result 1S related to a Similar 
result of Cox and Lewis (1966, Ch. 8). Recalling from 
eebae.5) thar 


meP? (4) = ma (t) + (p-1l)m_ , 


and observing that as t grows large the dependence on the 


arbitrary event diminishes and mp(t) tends toward m, so that 
Con ae ae 
M (o) = pm. 


Thus if the component processes have mp(O+) = 0, then 


meP) (o+)/moP? (@) = (p-1)/p . (7.8.5) 
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tee, Loe AR DLR et Nave pdt FOR CHE E(k ,p) “EROCESS 


In the E(k,p) process, the component interval pdf is 
ve) = ake Brte ty ceayt (7.B.1) 


The survivor function is 


Lee) 


a, 
Ry. (t) i YO) du 


-1l 


Y¥, (354) ; (743.2) 
J 


i ay 


iL 


and the equilibrium excess distribution is 


oo 


Cie) Ff R,, (a) du 
ue 


Z(t) 


(Ak) 7t 
j 


i} 


iuyS 


OD) YE, GN (7.B.3) 


Siboemeutine (7.bal), (7.8.2) and €/7.B.3) 1n (7.8.2) 


yields 


k 


P(t) = Cry(esd) 2 


a 


+ (p-1)/ (kA) 


J 


NE ea 
=) 


¥.(5,4)7°) 


k 
y ame (ean > 


fee Ve(F)}P7* (7B) 


1 


tl 


ie) 


ge ag Gg 


-—~— ee — - 





Computation of the pdf may be simplified by implementing 
the identity | 


¥,(3 nA) ¥,(k,m\) 


ats ri 
= Eto (Oo oy (j+k-l,mAtnaA) . (723) 
jtk-1 10 
(n+m) 
Thus the product of Erlang probability density functions is 
emocaled Eriang pdf, so cP) (¢) is a linear convex 


eemb ination of Eriang probability density functions. 


Using (7.B.5), (7.B.4) can be expressed as 


k 
ckP) (ey = (aKy* PE o£ (et1-5) ¥, (5,4) )P 7° 
j=l 


k 
x 2at c 27885) Gay ig) Gan ) ¥, (J+k-1,22) 
iat 


k , 
+ (p-1) & 47 ee ‘@ ¥, (25-1,2A) 
na ie 
jal 
| er , 
f epi) OF p97 65tn) Gun “VY (jtn-1,2d)} , 
jal n=jtl 
(78.6) 
N 
= ZX a.y,(3,pA) , (1eBat) 
iad 
Ohad 
N 
where N = p(k-1)+1 , r a, = 1 and a4 20, di lower es yes 
jo 
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Loo bine wlneorer Wilke h. | eand Oobservime trom (7.8.1) 


that for kal. You (kK 5A) = 0, and with E[X] = k/A , then 


iH 


r(P) (+) A (p+1)/k 


(pal )/p- 2 for X= hp. -. (7.B.8) 


Applying the formula (7.B.6) to the E(2,2) process 


yields 


@) 
f°" (t) 


LCI 72) een) + It )y¥aC352%) 
* (1/2) y, (1,24) EUCLA) aS fee) 


+ (1/2) ¥4 (2,24) 3/2 


(1/4) ty, (1,20) + ay, (2,2) + ¥,(3,24)} 


Wa8e0n 2s acentical with the prebability censity function 
derived for this process using the semi-Markov generated 
point process representation (6.A.4.5). 

Using (7.B.7) and Lemma VI.A.1, the r-th moment of an 


arbitrary interval of an E(k,p) process is 


(Paes — NO Gera -r 
EL(X Wee | oe set > (= a, (pr) : @ Pasrce 
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NUS, 


ecx'P)] = (pay7? 


and 


er(x'P?)2] = (pay7? j(jtLo, (7.B.10) 


1 Te oo art 
tJ 


J 
neeat| imvem Chapter Jil, Section A that in direct 
computation of the spectrum of intervals of an E(k,p) 
meocess, NO Provision was made for evaluation of the scale 
constant Q, (k 5p) (3,f,1.22)2) Cox and Lewis (1966, pp. 76) 
relate the initial points of the count and interval spectra 
of a stationary point process, given in equation (2.A.3.2) 


and expressed here in the notation of superposition processes, 
gs) cotyerx'P?] = chP) (otyc® (xP?) , (7.B.11) 


where c(xfP)) is the coefficient of variation of an 
arbitrary interval of the superposition. Equation (3.C.8) 


gives the initial value of the E(k,p) count spectrum to be 
g\P? (o+) = pa/(k°T) (7. Baal ) 

Howe (/-B.10), (72B211) and (7.B.12) can be used to determine 

micwititial point of the interval Speetrum, and thus provade 


the information necessary to evaluate Q,(k,p) in terms of 


the polynomial ratio representation presented in Chapter IIil. 


Jee A8, 





In Chapter VII, the computational details are described, 
and pdf's for several values of k and p are displayed which 
illustrate the results of Theorem VII.A.1, along with other 


more qualitative features. 


VII.C. THE ARBITRARY INTERVAL DENSITY OF THE 
H(k,p3;qa,4) PROCESS 


The component interval density in the HG. Dea...) process 


is given by 


lus 


co) = 


| a5; exp{-A, th, Hore ®. 
J 


1 


mich corresponding survivor and equilibrium excess 


Gest rioutLlons 


k 
R(t] Us a. fexpi-A’s0} C1. Ca2) 
‘=J al J 
a 
and 
k 
ie = Ciel) 2 GG. exe xery7 x. , (75O 3) 
je. J j J 
where 
k 
Pileaies-: 2 Gs/ka. « Cio) 
j=l eee 


Wsine (756.1) through (7.€C.4) in (7.8.2) gives the 
density of the arbitrary superposition interval for this 


process: 
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k k r. —-rA,t+A_)t 
e6P) 4) = ’ >: aan ( 52 a oa 1 e | rl 
A gat 


k q; Ge p-2 k @q.\p-l 
X ( TS ea ) ( y *) Cl. cas)) 
ee Jole 2 


4 *; 


Inspection of (7.C.5) reveals that e6P) (4) is also hyper-~- 


exponential and can be put in the form of 


where 


a ee) 
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Vili. NUMERICAG RESULIS 


Throughout the course of this research, considerable 
effort was expended in performing the computational proce- 
dures outlined in the various Sections of this thesis. The 
reasons for this effort were 


i> TOrvyersry the mevnodolory bY <comparing Vesults of 
varying approaches to the same problem; 


2. To establish the various procedures as practical 
methods of Obtaining answers to particular questions; 


3. To provide a basis for comparison between the various 
methods, and 


ioe IO Drovide Guadititatavye means of dist ineuishine «tne 
processes studied, and in particular tabulate the 
Forms ©r the Spectra and serial corretations for small 
p and k. 

Chapter Ili was devoted primarily to deriving an analytic 
representation for the spectrum of an E(k,p) process. 
section A of this chapter describes two methods of evaluating 
that representation. Included in the section is a brief 
description of the FORMAC algebraic manipulation preprocessor 
which has proved useful in several situations. 

Chapter V developed a method for computing the spectrum 
of a semi-Markov generated point process which involves 
Severmining the inverse of @ matrix Cle Se where w is 
the spectral argument. In Section B three methods of solving 
this problem are presented, each of which has been used 
Successfully in analyzing the interval spectrum of various 


E(k,p) processes which have been given semi-Markov generated 


point process representations. 


be 





MmCOnpirae Lonel .Orti hOReGierprObalDLhivcy density fPunetion 
Or son arbicrary incgerval of an E(k,p) process was derived in 
Chapter VII. Section C describes implementation of the 
method, including comparisons of certain specific values with 
those same values determined through spectral analysis. 

Seccvion D contains 2a brief discussion of the interval 
bispectra of E(k,p) processes modeled as semi-Markov 
generated point processes. 

Use of the Fast Fourier transform to determine the 
sequence of serial correlations of a point process from the 
spectral density is discussed in Section E. 

IMesoeeplon F the computation of tne Second order count 
spectrum of an E(k,p) process is presented. 

Throughout the chapter we give numerous graphs and tables 
Woven Tiluspcrace the properties of the functions being 
studied anc provide a basis for comparison between processes. 

Computer programs used in this analysis are listed in 


hppendix EE. 


VIGT.A, DIRBCT COMPUTATION OF THE SECOND ORDER E(k,p) SPECTRUM 


bewas, et a) (1973, Sect. 5), and Chapter III of this 
thesis discuss in detail the representation of the interval 
me spectrum of an Pies) process as proportional to the summon 
the ratios of trigonometric functions (3.A.22), wherein 
Q, (kp) is defined as the constant of proportionality. 

Two methods of evaluating (3.A.1.22) have been developed. 


The first, developed by W. J. Hayne, (See Lewis, et ai, 1973) 
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evaluates the summation numerically for a finite set of 
values of w. The second, developed to supplement this 
research, makes use of the symbolic manipulation capabilities 
of FORMAC (Raney, 1973) to determine an exact formulation 

as the ratio of finite polynomials in cos w, as expected 


fromeineorem tit.sA.ac. 


VITT,A.1 Numerical Approximation of the E(k,p) 
Interval Spectrum 


The compuvational form of the second order spectrum 


@iethe E(k,p) process is (3.A.1.22) 


Gc: em emi 


with J, ays by and Cz as defined in (3.A.1.23). A direct 
numerical evaluation of (8.4.1.1) was implemented in a 
FORTRAN program, SPECD. The program was used by Lewis, et 
al. (1973) in the preliminary research of the Erlang 
SUperDOSItTiOn process. 

The following procedure was followed by SPECD: 


a. Enumerate the distinct sets 


J EA) qom eitsel i J,=lse- 5k i re © 


Dp 


by setting j=l, i) aes Oren INC Cmeny ie lie unites wae 


as CO maintain the inequality Jy Sg Jie LOOP: 3) 7s x 


oD 





pee Or cach Valle "“Olenachosenauni ormly bepween 0 and , 


and each set J, evaluate 


2\ Ila, 


ae 
(aytby ey 


where |J| represents the number of distinct permutations of 


the elements of J. 


ec. For each w, set 


LO ELL (Se hee) 





2D ms Zoe 
Ak g (a5tby)e, 


d. Use quadratic extrapolation to evaluate U(o) and U(m). 
e. Since the integral of e{P) (y) must equal 1, and 


riP) (yu) = Q,(k,p)UCw), approximate Q,(k,p) by 


N 
Q,(k,p) = {(n/N) U(w, 3 (8.4.1.3) 
;=0 
where Ws = TI/N. 
(p) _ ; 
fe oct ft. Cw) = 0, 0k, p)UCw, ) ; (8.A.1.4) 


Some additional information available from this program 
is the variance and coefficient of variation of an arbitrary 


interval. Using the relation 


gi?) (0+) = pa/ (ken) | Cia eee) 
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and 


e{) (o+yeex'P)y = £fP) (oryc®ex'P)] , (8.0.1.6) 
previously given as (3.E.6) and (7.B.11), where x 6P) 
represents the interval following an arbitrary event in the 


Sueer position process, yields 


07rx'P)y = (r'P)(otyen)7t (8.8.1.7) 
and 


vex'P)] = {k/(p?a?ael?? (ory) (8.8.1.8) 


Freures Vill. A. through VilI.A.10 are conmperetive 
spectral density representations of the various E(k,p) 


epeccraceeneraved by the foregoins method . 


VIII.A.2 Analytic Determination of the E(k,p) Interval 
opectrum 


This phase of the research made use of an algebraic 
Meamipulation routine, FORMAC, to compute a condensed formula 
of the second order interval spectrum for specific values of 
kKand p. Theorem III.A.2, guaranteeing that the interval 
spectrum of an E(k,p) process was that of a mixed auto- 
repressive/moving average process, required examination with 
Gegame CO CONlstiine the €Stimaves of the ovder of the process 


as proposed in Section II1.D. 


ae 





ts) 





D=e 


+4 Gee 2 yo oO aut ff Oe oC 8 ae eae 


TT 


=8 
t/t so 3 1/2 27/3 3/4 W a 
ee pp 
8° 6 yo 3 =) 


Figure VIII.A.1 Interval spectra, p\P) (yy, fOReE (2,0) 
superposition processes, p=2,...,8. The squares at 


g{P) (4) = = represent the flat spectrum of a renewal prccess. 


Note that for k=2, the spectrum is fairly flat with a notch 
Swe Oping near the origin with increasing p, as the initial 
point of the spectrum approaches its asymptotic value, 1/kT. 
There is a relative peak at w=tT (period T=2) representing 
the quasi-~alternation between events from the two processes 
mOr p=2e. 
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eis GE) ty 


e6P) (4) 






mm, 


n/t 1/3 1/2 em / 3 Bn /4 
8 6 rt 3 | 
3 


Figure VIII.A.2 Interval spectra for the E(3,p) super- 


position 
ene flat 
a p=2, 3 
n/o(T=4) 


process, p=2,...,%. The squares of 1/7 represent 
spectrum: ol a renewal process. Hote the humps 
and 4 spectra centered at w(T=2), 27/3(T=3) and 
respectively. 


ibe), 


Fe 





= awe 
£6P) (w) | 
oe, , 


Rote XK ok (aCe ee ec 





‘a Ck 
Cas 


| ae 
PR KK 


1/4 11/3 1/2 em/3 = 3m 7/4 ma 
eS ee ee eed Lace Ae e . 
3 6 y 3 2 
Figure VIII.A.3 Interval spectra for E(4,p) superposition 
Processes, p=2,...,6. The crosses at 
£tP) (y) = < represent the flat spectrum of a renewal process. 


As in previous cases, relative peaks at periods p appear in 
mae spectrum diminishing in amplitude as p increases and the 
spectrum approaches the flat spectrum of the Poisson process. 
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p=3z 


p=4 m»—_» 


rtP) (wy) , | 
| 


HK K KKK XX KKK X/KX WK XXX KK XK KX KK KKK : 





T/4 = T/3 m/2 om/3  -3n/4 » 7 | 
ee ee ee eee 
6 6 y 3 ee 


Figure VIII.A.4 Interval spectra for E(5,p) superposition 
processes, p=2,3,4. The crosses at 
cP) Cy) = 2 represent the flat spectrum of the renewal 


process. In addition to the relative peaks exhibited in 
previous plots, a secondary Deak can be seen at T=p/2 for 


| 
the E(5,4) process. As in previous figures, r{P) (o4) 


decreases monotonically toward 1/kt as p increases. 


AO | 





Figure VIII.A.5 Interval spectra for the E(6,p) 
processes, p=2,3,4. The crosses are as in 
previous figures. As in the E(5.4) process, a 
second peak at T=p/2 appears in the EAC ©) 
process, probably representing an harmonic. 

The main peaks are at periods T=p. 


£{P) (wy) 


p=4m— 


é 


Vere (EG Kh Km As RP ON RR OR 


[re 








T/ 4 1/3 1/2 2m/3 30/74 : 1 
2 ——---} -- - -—  — ——- +] apa et 
8 6 4 2 2 





AIH 


~~ oD 


Figure VIII.A.6 Interval spectra for the E(k,2) 
processes, k=2,...,8 The crosses at 


( 
£6) Cw) = 1/t are as in previous figures. Note 


the sharp peak at w=T representing a period of 2 
and increasing as k increases. This is because 
the intervals in the component processes become 
less dispersed as k increases (coefficient of 
variation decreases, Fig. ViII.C.1), and the 
alternation of comoonent events in the 
superposition becomes more pronounced. 


Be (w) 


MRA AR AACR KR XK: RAAT KN KR an) 





tT/H ot /3 1/2 anf 2. 3174 7 
ee 
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fee" Cw) k=7 
k=6 
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fo) 
. ae my tg to tf ¢ ty to "2 tf ° Zt OS eo ca ge hee ty ty ec 
7 Beek ARK Kk eK 4. aid 04 ae ae ee oleae ae ae ee ya 
a ee 
ees cece ss 
n/4 VW 32 Tae eT/ es 31/74 TI 








a ee eee eee EE LIC. eee eee em ||) Sa fk! a 
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Meoure Vill.A.7 ~Interval spectra for the 5(33) processes, 
k=2,...,8. The crosses are as in previous figures. The 
peaks at w=27/3 correspondinggs to a period T=3, clearly are 
Increasing with k. 
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£{P) (w) 





Ree A KR RK AK A KOK KR RRA KR A RR RRR 


t/4H = /3 1/2 2n/3 30/4 
8 6 y 5 
Figure VIII.A.8 Interval spectra for the E(k,4) processes, 
bee 550. The erosses at 17m as sbetore. wWithyp even, 


we see the indication of an harmonic peak at period 
T=p/e-2. becoming more pronounced as k increases. 
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Figure VIII.A.9 Interval spectra of the E(k,5) processes, 


k=2,3,4. The crosses as before. Here we see a main peak 
at T=5, w=27/5, in the E(4,5) process, a secondary peak is 
apparent at T-5/2, = Un/5.° These peaks would be expected 


to become more pronounced as k increases. 
e) 
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iw xe KK XK KX 
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p\P) (a) 





k=4 


tm/4 1/3 1/2 em/3 30/4 T 
8 6 h 2 is 2 


Figure VIII.A.10 Interval spectra for the E(k,6) processes, 
k=2,3,4. The crosses at 1/7 as before. Here the main veak 

is at w=1/3 (T=6=p) with a secondary peak at 27/3(T=p/2) for 
the E(4,6) process. 


207 





Wiive -sichecompuLeation 16 NOt dtiileule to do by and 
for k=2, and p=2, 3 or 4 (Fig. VIII.A.11) the magnitude of 
the coefficients (in integer form) and the number of terms 
involved for larger values of k and p renders hand calcula- 
tion virtually impossible. However, integer calculations 
were required so that differentiation between zeroes and 
very small numbers would be possible. 

SuvadiViswon Viti A. 2.4 Contains a description of the 
problem in such a way that an algebraic solution is feasible. 
im oupoivision Vili.f.2.b Wer give a brief description of 
FORMAC outlining those features which make it suitable for 
Gais problem, a@longe with the drawbacks which Jimit is 
uselulness. 

Vili Asewa Propiem fPormusation 
To solve algebraically for one interval spectrum of an 
E(k,p) process, begin with the formulation of Chapter III, 


Section A, given by equation (3.A.2.4) 


28 
ri) (w) = @,(k,p) Breage” (a, )1 a 


ie: 
Ak JB (ato) eo, 


where, it will be remembered, R. is an index designation 


vector with elements, Lo» Wngen are “distinct permutavions 


yk/2) (ny, 


of the same set of integers. (The sets as defined 
in Section III.D, are used in place of the index désignation 
vector, Res Vinemnk 2s Ven, Ine Convession 25 Tedious: out 
Straightforward, and discussion will be omitted.) 
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The general procedure to be followed is to enumerate 


the index designation vectors, {R,}, and form the sum 


cay 
S; (w) = 2 oe Goats 22) 
LeR, (a; tb) )e, 


for each Ry Bech sum, S,(w); 1S UNen placed over a2 comnon 


denominator, so 


The terms N, (w)/D, (w) are combined to form 





(Meas ie D N,(w) 
SC). = sae : (Oe n8) 
rAKeP = (Re) D, (w) 


which again is placed over a common denominator. 
Finally, using the known value of rtP) (on) WO Oebichoncelal 


C7 3.2) Q, (%,D) is determined from the ecuation 
c{P) (0+) = O.(k,p) S(OH) (8.8.2.4) 


The actual procedure is most easily explained 
througn an example: 

BHenvle Willian. The 27terval. spectrum oT 
the E(3,3) process, The class of all index designator sets, 


Res can be operaticnally defined by 
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ee eee {(nj5-+- sm) |[penj;en,,)>0,j-1,...,k-13 Fa ld 


For the E(3,3) process 


{R HGS O50) es nO) ad) 


3 


= {R R R 


a es Piles 3} 


Recalling the definition of S, Cw) (S:.A.e.2), and the 
results of Lemma III.A.1, as expressed in (3.A.2.5), 


rene. > Gene. 6) and (3.4.2.9), 


H 


3 : 
(as: {1-cos (S444 3 ° 


Sean, 
1 ra 


3 . 
(1/3) LT {1-cos (23°) 333 


|», (86.206) 
ioe (iecos a) } 


At this point a FORMAC program must be written which 
PSewaiored ToOrcme Specific problem. Using the adentities 
expressed in (3.4.2.12) and evaluating the sine and cosine 


terms, the numerator of S,(w) becomes 


N, (Cw) = [2t+tcos(w/3) - 3sin(w/3) J[1l-cos(w/3)J(1/2) 
+ [2+cos(w/3) + 3sin(w/3) ][l-cos(w/3)](1/2) 


+P teosta/ 3) = g52niw/ os) iletcou u/s) + 3siniey7 31) 
(Sotwcw fe 
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which is easily evaluated by FORMAC. Substituting the 


appropriate identities from Appendix B results in 








C 
S,(w) = BCS eee Ome OS. : 4 cos’ w) (8.4.2.8) 
(1 - cos w) 
Dear ly, 
- 3 (3-2cos= 4% - co osSEE4) (1-00 sey (l- cos) “< 
Satu) = Sh 2 Cp 
il. i 
2 j=1 mJ (7- boo ae 3 ES, eos ae 
5 3 (8.A.2.9) 


15 evaluated in a specially constructed FORMAC program, using 


appropriate trigonometric identities, and becomes 


2 


(14274 + 2439c0os w - 918cos*w + 81cos2w) 


S,(w) = —= < < 
‘ (l-cos w)*(27eos-ut169) 


(6. A.2.10) 


Wiemelnde x Ceotenan1Or Set ka represents a single element 
— 


which, when evaluated as above gives 


: 8 
S3(w) - Al Elaao can (8.8 2 a 


Subeoti tities (6.4.2.0), (C.A.2.90) and (S.A. 2.deia 


(oeiees 2) Vielas ehe ainal form of S.¢@) > 


S(w) (l-cos w)3(S) (w) #385 (w) +683 (w) }/A3° 


! 
— (24987 3+142020cos eee ea ona ionees tele eae au) 


(169127608 “w)) 
(3 eer 


eae 





Using the results of Chapter VII (7.B.10) ana 


(7.B.12) as implemented in Section B of this chapter yields 


g 63? (0+) 


A/( 3m) , 


c2rx (3) = 3283 
and 


epx(3)) = ay... (8.A.2.13) 


Using (8.A.1.6) and (8.A.2.13) gives the result 


r\3) (9+) = (d/37) (1/2) /( 3983/6561) 
= 6561 | 
” Cee) CBN) 


Pr 


Evaluating (8.A4.2.12) at w=0 and using it along with 


(8.A.2.14), gives the scale factor Q, (3,3): 


2 on 
O53) = 30237 (8.A.2.15) 
Thus the final expression for the E(3,3) 


interval spectrum becomes 


+ 


(169+27cos“w) 39837 
(8.A.2.16) 


ave 





This completes Example VIII.A.1. However 
reference will be made to this example in the following 
section. Exact results for processes evaluated in this 
manner are tabulated in Figure VIIlI.A.1l. 

Recall that the order of an ARMA(m,n) process 
is reflected in the degree of the coSine polynomials in the 
spectral representation. In the case of the E(3,3) process, 
the similar process is an ARMA(2,4) process, giving a 
spectrum whose numerator is a coSine polynomial of degree 4 
and whose denominator is a cosine polynomial of degree 2. 
Note that not every ARMA(2,4) process is similar to the 
E(3,3) process; only the one whose spectrum is given by 
Coe ie2.. WO), 

An important feature of the results tabulated 
in Fig. VIII.A.13 is their consistency with the degree of 
the similar ARMA processes tabulated in Figure III.C.1. 


VIII.A.2.b. The FORMAC algegraic manipulation 
preprocessor 


"PORMAC (FORmula MAnipulation Compiler) 
Drevrdes...a COOl FOr Deriorminge Symbolve manipulation 
of mathematical expressions along with the usual 
features of a numerical mathematical language... 
Expressions to be manipulated can contain variables, 
WSer-Celtineca GUnCcGITONns, COnStanus, Symbolic cComstants 
and {uneeions. Bepressions can be differentiated, 
evaluated, replaced, compared and parsed. "1 


lraney (1973, PD. +). 


2a 





Figure VITi.A.J]1 Algebraic representations as ratios of 
Gos WU DOlYnemlals Of the second Order interval spectra of 
certain Erlang superposition processes. The expressions 
piven for each spectrum are cenoted N, D and @. The 
spectrum is 


fi (w) = QN/ D 
Those processes marked with an asterisk were computed by 


Bevis. eb al. (19073). 


The computational difficulty associated with this computation 
is illustrated by the resultant formula for the E(4,4) 
interval spectrum. 


imese were computed by hand for small k and p, and with 
FORMAC assistance for higher k andp. 


E(2,2) process# {ARMA(1,0) spectrum} 
N = 1 - cos w 
oe 
Q = 1/5 

E(2,3) process#* {ARMA(2,1) spectrum} 


ife= 121 = 48 cos. w = an 


De= 41 — © COs 4H 


Q = 9725 
E(2,4) process#* {ARMA(3,1) spectrum} 
N = 871 - 502 cos w - 57 cos’w - 24 cos 3u 
D=17- 8 cos w 
Q = 8/379 
E(3,2) process {ARMA(2,1) spectrum} 


N = 3942 + 2241 cos w + 378 cos‘w 


65 + 16 cos w 
H/4NQ5 


aD} 
| It 
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Figure VIII.A.11 (continued) 


E(3,3) process {ARMA(4,2) spectrum} 
Noa UOMe jan 1 20020 cos mee 22.389 eos -u 
+ 17,496 cos3y + 648 cosy 
D= 169 + 27 SOoar 
Q = 3/3983 
E(4,2) process {ARMA(2,1) spectrum} 
N= 31 - cos“y 
D= 3 + cos » 
Q = 256/3495 
E(4,3) process {ARMA(5,3) spectrum} 
N = 182,141,315,652,508 - 78,862,095,096,808 cos w 
~ 42,822,137,630,712 cos*w + 25,599,977,898,816 cos w 
+ 207,765,000 cos 4y 
D= 43,835 ,592,913 ~ Nee) 515) 2 ecemarey 2) COS W 
+ 19,683,026,163 fos - 4,100,625 cos jy 
Q = 6561/8,913,904 
EC4,4) process {ARMA(8,5) spectrum} 
N = 310,464,417,651,734,009/8 
+ (1/7 6)11.,7 7605007 5 303.000,59040490 cos w& 
+ (1/8)25,218,699,913,699,885,013 cos“u 
b (1/9)? 1., 251, 879,278.015.791,,083 cos nu 


~ 1,060,176 ,380, 434,254,450 cos ty 

+ 026.910.575.509, 105.072 cos2n 

pmo 0. 207,072.03) 060 oe 

+ 17,367,184 ,018,767,872 cos ‘wy - 1,090,519,040,000 cos 
Do 30 624,100,279 01 = 64,640,€620,663,704 cos ou 

+ 115,164 ,588,505,856 cos*w + 75,974,636,240,896 cos -u 

~8,481,012,711,724 cosiw - 335,554,320,000 cos?w 
Q = 1,556,391, 325,136x107°/833 ,625 450,472,186 ,167, 743,918,509 


e 


08) 
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Puevres Villon (continued) 


E(5,2) process {ARMA(3,2) spectrum} 
N = 4,043,205 - 47553 cos w - 224,126 cos“w + 9728 cos uw 
D = 1,174,529 + 720,192 cos w - 4096 cos<w 
Ge= 16076 0 
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The above description summarizes the properties 
of FORMAC. The specific capabilities of FORMAC which loaned 
themselves to this phase of the research were 

ie ehbt lieve ncO nai Meet TOrmilawimeacrity. That is, to 
keep track of variables in symbolic form so that 
thes CONnVTribUedoen, Or “each, Darameter to the final 
result is directly apparent. 

22 Ability to periorm polynomial multipliveation, 

3.) The capacity to maintain extensive formulae in exact 
fori. IUneererecoecr cr ents Can Have tune o 2295 
digits, while formula length is only limited by core 
storage available to the program. 

4.) The capability of implementing simplifying substitu- 
tions, as for example, the trigonometric identities 
or sopenecax B. 

In evaluating expressions of the form shown in 
Mona. 2.9) the identity 


en re) = cos(2tj/k)cos(w/k) - sin(21j/k)sin(w/k) 


cos ( 
was used to isolate the variable terms cos(w/k) and sin(w/k). 
For many values of j and k, there are no rational equivalents 
to cos(21nTj/k) and sin(2tj/k). Thus, to ensure that cancel- 
lation of terms, where it occurred, would not be masked by 
momerical imprecision, and conversely, not be indicated by 
very small coefficients, the terms cos(2tj/k) and sin(21j/k) 
mere retained as symbolic entities. 

B@weewens (O.hae.9) and (0.A.2.12) tilustrate 

the need for polynomial multiplication. There S5(w) is the 
sum of polynomial fractions in sin(w/3) and cos(w/3). Each 


step of the procedure which expresses Sy (w) as a single 


ale 





eolynomlal fraction requires multiplication of polynomials 
and collection of like terms. At the same time, these 
polynomial products involve many terms in various combina- 


bons Of 
sin” (273/k)cos®(20m/k) cos” (w/k) sin” (w/k) (8.A.2.17) 


which must be maintained in their entirety until simplifying 
relations can be imposed. 

The method of feneratine the compect form of the 
spectrum of an E(k,p) process is iterative in nature. It is 
not clear at the outset which trigonometric identities will 
Reduce the complicated Tormulae to the desired form. The 
eeoblem must Tarst be run without SUDSTITUTIONS Of any kind. 
E2560 0n the results of the preliminary run, a set of 
substitutions designed to convert sin’’ (w/k) tO oees- (ayn. 


ev—l ek) 


and all symbolic coefficients of cos Cue and sin 
BO rational numbers. (2G 1 Setiov, Clear nat this is always 
possible, but it was worked out for those cases actually 
considered.) The final stage requires the conversion of 
cos’ (w/k) tO ©€os(tu/y). At this Step, correct formulation, 
eorrect substitution and Theorem JII1.A.2 guarantee the 
Bancellation of terms for wnich t is not an integral 
multiple of k. 


iwe Serious drawbacks to this procedure exist. 


First, the FORMAC analysis is extremely demanding in terms 
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of computer space and time. A final run for the spectrum of 
the E(5,2) process, once the appropriate substitutions had 
been determined, required 378000 bytes of storage and 73 
minutes of central processing unit time on the IBM 360/67 
computing system. 

The second drawback is in determining the first 
Stage substitution requirements and substitution identities. 
As can be seen in (8.A.2.17), a great many combinations are 


possible. In the E(5,2) analysis, with 


a, = cos(2n/5) =-cos(3m/5) = - cos(71/5) = cos(81/5) 
De Sin(2n/>) = sinC375) = = sin( 71/5) > = sin(éen/5) 
a, = cos(4n/5) = cos(6m/5) = - cos(9m/5) = - cos(m/5) 
ba SinCin75) = = sin(6n/>) = = sin(91/5>) = sin(1/5) 


Some typical substitutions were 


3 3 5 3 _ 6 
bj b.6a54a, _ D5b, a} a5 = - 5/2 
a +a = 2/2° 

ca 8 


All of the above forms were derived from the basic identities 


dovteoee= «1/2 . 


and 
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In all, 41 substitutions were required for the 
second stage computations. The number of such substitutions 
increases rapidly with k and p, along with the complexity of 
the terms, the time and the space required for the computations. 
Using this method on a process such as the E(7,3) process is 
virtually impossible. 

VITI.B. THE INTERVAL SPECTRUM OF THE SEMI-MARKOV 
CENE RATED’ POUNT Pr necess 

The interval spectrum of a semi-Markov generated point 
process, as shown in Chapter V, (5.B.5) involves the inverse 
of the matrix (Iu-T). In order to form a workable expressicn 
for the spectrum, a practical method for perrorming the 
Benversion of a matrix containing a variable term is required. 
Three methods have been investigated for this purpcse. The 
methods are designated algebraic inversion, diagonalization 
and numerical approximation. 

subsection VIII.B.1 details the method of algebraic 
mnversion, by which a modified Gauss elimination written for 
the FORMAC preprocessor was used to find (Iu-T)71 directly. 

Subsection VITI.B.2 describes the use of diagonalizing 


matrices P and p—1 tO 2 Jad 
Gey) | PclueD) 2 


where p=p-1tp is a diagonal matrix. 


e729) 





Subsection VIII.B.3 contains an explanation of the use 
of equation (5.B.12) to generate a numerical approximation 


of the interval spectrum. In this method, the summation 


im 8B 


a7 M, (TI7*_T*)M, Teos Jw 


j=1 


i 
wm =& 


T J=1, 2 
T Mo CT -T )M,leos jw 


j=l 


with the error decreasing geometrically with N. 

VIII.B.1 Algebraic Inversion of (Iu-T) 

The method of direct algebraic inversion relies on the, 
theory of integer preserving Gaussian elimination. (See 
for example Bareiss (1968)) 

Hhesprocedure is this: 

To the matrix (Iu-T), and an identity matrix of the same 
dimension, apply a sequence of identical transformations 
which will transform (Iu-T) to an identity matrix. Then the 
matrix which results from the sequence of transformations 
applied to the identity matrix will be Coes aa In the 
iterative Gaussian procedure, denote the state of the 


original matrix after it has been operated upon n-i times 
(n-1) 


i 
matrix by je). 


by fa }, and the correspondingly transformed identity 


tet q Ma, (n-1) (0) 


an 9 BELs-e+ sm; 4 


=1, where mis the 


dimension of the matrix T. Then for i¥n, 


eel 





et - COs ieee bears ies (n- -1)) ,4(n-1) (8.B.1.1) 
(n) _ ¢,(n-1),(n)_, (n-1), (n-1) (n-1) 
Da; = (Dy d -bn3 Asn )/a (8.B.1.2) 
and 
ee a ma -1) , pin? = -1) (8.B.1.3) 


Two important features of this computation are, 
from Fox (1965, Ch. 3), 


a. The term q(n-1) 


divides the terms of (8.B.1.1) 
and (8.B.1.2) exactly, and 

b. If (Iu-T) is of order m, then g iM) is the 
determinant of (Iu-T), and oe) is the adjoint. That is, 


sth B={bi"}, then 
(Iu-T)71 = pya’™? (8.B.1.4) 


Although the divisibility property, a, is easily 
(n) 


(1) 


verified, it must be remembered that d is a polynomial in 


u for n=1,...,;m. Initially, we have d =u-tj4> and from 
.8. 1.2), 
622) ape L 
d = {(u-to5)(u-t,,)-t eae 


dave 1 


“4 and pi) 


It is necessary, therefore to perform polynomial division 


Similarly, the terms a are polynomials in u. 


to force each new element into the proper form. 


Zee 





A polynomial division algorithm presented by Knuth 


n 
(1969) was used: Let Asapx +...t+a,_,xta, , and let 


X+b with m<n. it is desired to find 


fot 
B=D x +...tb, _,xtb. ; 


Cacyc +. ..4c, 1 xtc, =A/B. The result requires n-mtl 


iterations with k=n-m. At iteration j=0,1,...,k, 


(J) 


Cs = a, 106 
where 
at) eb, , raigel..<. dtm 
Gi) 
an 
a(J-1) » r>jt+m 
r 
and 
Ce 


This scheme was implemented using the FORMAC 
preprocessor. The special capabilities of FORMAC which 
suited it to this problem were, in additon to those previously 


listed, the expression analysis capabilities. In particular, 


a. The ability to extract coefficients of given terms 
from a given expression, and 


b. The ability to determine the greatest and lowest powers 
of a given term. 


At any point of the inversion that a division A/B 


was required, FORMAC commands determined the degree of A 
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and B as polynomials in u, extracted the coefficients of ud 
in both expressions, and executed the division algorithm. 

To evaluate this and the other methods listed below, 
several semi-Markov point processes were constructed which 
were equivalent to the Erlang and hyperexponential super- 
positions using the methods detailed in Chapter VI. Of 
interest here are the compact formula for the interval spectra 
as compared to those tabulated in Figure VIII.A.11, and the 
plots of the hyperexponential superposition spectra shown in 
Figures VIII.B.1 and VIII.B.2. Plots of the Erlang super- 
position spectra from this method are not shown as they are 
identical for small k and p with those produced by the 
numerical routine, SPECD, which is considerably more efficient 
in terms of both time and storage requirements. 

It should be noted at this point that producing the 
exact polynomial form of the E(5,2) process interval spectrum 
required less than two minutes by the algebraic inversicn 
method, as distinguished from the 73 minute run using the 
direct computations of Subsection VIII.A.2. As the 
dimension of the transition matrices increases, numericai 
error seriously interferes with the results. 

VIII.B.2. The Diagonalization Method 

In this method of matrix inversion, it 1s necessary 

to find a matrix P such that TP=PD, where D is a diagonal 


matrix. In particular, the matrix D has the eigenvalues 


lonis method was suggested by Dr. M. Rosenblatt during 
Pmvasit to the Naval Postgraduece School. 
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ee?) (w) 


0.50 q,=-1; 0° (x)=2. 76 


a 


bq1=.3, c@(x)=2.71 


A 


2 
G.=~5e-0 (x)=2.05 
iL ve 7 3 
T 
0.25 _ Wt 1/3 1/2 | | on/3 30/4 vo 
8 6 4 3 2 


Figure VIII.B.1 Interval spectra for the H(2,23;q,A) super- 
position process; Ayal, q,=-1,-3,-53 AyD=1=-A, ; Q5-l-q,. These 


spectra were obtained from the semi-~Markov generated point 
process representation of the H(2,23;q,A) process.. Note that 
the sharpest peak results from the process in which the 
dominant exponential component has the highest intensity. 


The coefficient of variation refers to the superposition 
interval. 
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£0?) (uw) 


0.50 
= 2. 0° (x)=2 76 
pee 1 ¢ 3 e 
A.=.25, 0° (x)=1.19 
— 1 e 5 4 
w—«*OM YD 0°(x)=1.15 
de 
T = 
1/4 T/3 1/2 2n/3 3m/4 
0,25—— ; 7 
8 6 4 3 
Figure VIII.B.2 Interval spectra for the H(2,23;q,A) super- 
Pesition process q,7-l1, Aj=.1,.25,.9, A5=1-A,. Consrouctien 


omevhis eraph as in Figure VLI.B.1., Yote that with the 
dominant component in the hyperexponential distribution 
moving a Slow rate, Aso=.1 the spectrum is nearly flat. 
Comparison with Fig. VIII.B.1 indicates that the spectral 
density is not closely related to the coefficient of variation. 
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of the matrix T as its diagonal elements. The matrix P may 
be made up of linearly independent representations of the 
right eigenvectors associated with the eigenvalues of T. 
Then 

T= ppp + 


So thas 
(Iu-T)72 |= ¢pp7ty—ppp7+)71 


P(Iu-p)7~+p-2 (8282-1) 


Clearly, (Iu-D) is a diagonal matrix with elements 
u-A,;5 where i, = ds is the i-th eigenvalue of T, so the 


inverse can be written directly as 
Glw=p)"* = (6vq@ier,)—-} (8.B.2.2) 
a a’ : 


where S53 is the Kroneker delta. 


Referrring to (5.B.5), 


f(w) = m7 {My+M,[(1u(w)-T)7 74 (Tu (-w)-T) 77 JM 31 


a {Mo#M, PE(1u(w)-D)~2+(Tu(-w)-D)~2yp7IM, 1, 


Where u(s) = exp{-is}, with 1 = V-l. 


Ce 





SUbSereUuLineg from (OnBeese) 5 


Cian Dy meee aCluceu) =D) 


-l -l 
£85, (u(w)-Aj)7 + (u(-w)-2,)7 "8, 5} 
= {25,,(cos w-r5)/(1-2h cos wea} (8.B.2.4) 


It is a simple matter to complete the analysis 
using a FORMAC program. 

Actual computation of D, P and p-l made use of the 
IBM Scientific Subroutine Package (SSP-360) routines DEIGENP 
and CMTRIN, the latter modified to perform double precision 
arithmetic. DEILGENFP is a program which computes the eigen- 
values and eigenvectors of a general real matrix by means 
of the Q-R method. (See for example Stewart, 1973). 

CMTRIN computes the inverse of a complex matrix by the 
method of Gaussian elimination. 

This method worked very successfully with small test 
matrices, such as that of the semi-Markov generated point 
process equivalent to the E(5,2) process which had dimension 
5 and real eigenvectors and eigenvalues. On larger matrices, 
Such as the semi-Markov generated point process equivalent 
to the E(5,3) process which has dimension 15, the numerical 
errors grew to the point that meaningful analysis was 


impossible. It is possible that some error reduction 
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techniques might be applied which would render this method 
useful for larger matrices. 

No effort was made to determine if, in general, the- 
stochastic transition matrices considered here are 
dilagonalizable. It was assumed that such a procedure was 
feasible, presuming that if the assumption were false, it 
would be indicated by the numerical results. 


VIII.B.3. The Interval Spectrum by Numerical 
Approximation 


The definition of the interval spectrum of a semi- 


Markov generated point process, given by 5.B.12) is 


f.(w) = {14S 2 aM (TITLLTyM_ feos jwh/t . (8.B.3.1) 
a 2 ,., - Ll l= 
Go j=l 
Beom (5.58.15), it 1s known that Td converges geometrically 
to T , as j grows large. Let br’ > max{|t'd?_¢6*) 1} , for 
_ ik ae 
some O<r<l. (The existence of b and r are shown by Kemeny 


and Sne1l1,1960). ‘Then 


J og aM (TET? Ma] < aTMSID rod 
jJ=N+1 jotta 


s nMSbrs/(1-r) , (8.B.3.2) 


That is, the truncation of the summation in (8.B.3.1) at 


jJ=N has error bounded by the right hand side of (8.B.3.2). 
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The method of numericai approximation outlined here! 


is computationally the most efficient means of generating 
spectral values. It has the side benefit of providing the 


first N serial covariances directly. 


VIII.C. THE ARBITRARY INTERVAL DENSITY OF THE E(k,p) PROCESS 

In Chapter VII, a computational form for the density of 
an arbitrary interval of an E(k,p) process was given (7.B.6), 
with the product of two Erlang density functions given by 
Ba). 

Evaluation of (7.B.6) made use of two properties of 
FORMAC not previously mentioned. First is the capability to 
evaluate combinatorial expressions such as (% ) . The second 
property is the ability to manipulate functions in symbolic 


form. For example, H(j,n) is defined by 
BG .n)-= (nd)J xJ mt exp fenax}/{(J-1) 1} : CSAC.) 


Then equation (7.B.6) can be evaluted in terms of H(j,n), 
performing the operations indicated in (7.B.5) at each step. 
The right hand side of (8.C.1) can be substituted into the 
final form for numericel evaluation of the arbitrary interval 
pdf, or the expression can be examined as a linear combina- 


tion of Erlang densities, H(j,n). The representation in 


loueeested by Professor W. M. Raike of the Naval 
Postgraduate School. 
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which the function H(jJ,n) was replaced with the Erlang pdf 
was used to generate the comparative plots shown in Figures 
VEEE.C.1 Ghrough VETISC.4. 

Two features of the plots are worth special note. The 
first is that the initial points are in agreement with the 
result stated as Theorem VII.A.1. That is, for the 
arbitrary interval density of an E(k,p) superposition process, 


with A=k/p the initial point is 
r{P)(o4) = (p-1)/p_ . (8..2) 


A second point is that regardless of the parameters of 
the case, each arbitrary interval density is unimodal. 
While it has not been proven that this holds generally for 
all k and p, it may be conjectured that this is the case. 

It is interesting, and perhaps counter-intuitive, that 
the distinct shape of the Erlang density functions tends to 
be retained more with k=2 than with higher values of k. In 
any event, the special shape is no longer apparent for k>4, 
and the superposition pdf looks much like the exponential. 

Because the final form of the density is a convex linear 
combination of Erlang densities, expectation, variance and 
coefficient of variation can be obtained directly from the 
moments oi tne component distributions without integration. 
Equation (3.E.8) gave tne initial value of the spectrum of 


counts which can be combined with the expectation and 
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f(t) 
1 ¢ 


f(t) 
7/8 


6/7 Ar (2,8) 
s/o G 
4/5 


3/4 
273 
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ae 
1S) » a 
=4 ; 
S Ce) 
0 = ie 
‘ 1 2 | e 
Figure VIII.C.1 Arbitrary interval densities for E(2,p) 
Superposition processes, p=2,...,8. All distributions 
normalized to unit mean(A=k/p). The squares represent 2 


EMrte exponential pdf. The diamonds trace a ¥, (252) paf. 


The initial points are (p-1)/p for each curve. This figure 
illustrates the dependence on p as the pdf curves rapidly 
lose the distinctive Erlang shape and approach the 
Cxponential curve. 
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1/8 
f(t 


3/4 


2/3 
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0 il 2 


Figure VIII.C.2 Arbitrary interval densities for E(3,p) 


BUperpoOsSiItion orocesses, Sdvares, diamonds and normalization 
moment Cure. Vili... wig K-35 -Ene cdasyinclivewsshape oT 
the Erlang odf fades more rapidly with increased p than 

for k=2. The trend continues with larger k, so that by 

k=5, p=3 the pdf looks exponential. 





So 


Liz 


nae) | 
a 
a 
q 
‘ oa 
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Pigure VIII.C.2 Arbitrary interval densities for E(k,2) 
superposition processes, k=2,...,8. The squares denote a 
unit exponential pdf. The arbitrary interval pdf's are 
normalized to A=k/p. While each curve has the common 
initial value of 1/2, the maximum values diminish and are 
more distant from the origin as the densities seem to be 
taking on a rectangular form with increasing k. 
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f(t) 
QO 
0 
OG 
2/3 id 
— ws 
FR E(6,3) 
aS ( 
OG 
E(2, 3) 
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Figure VIII.C.4 Arbitrary interval densities for E(k,3) 
Superposition process, k=2,...,65 normalization as in 

Fig. VIII.C.3. Here the node associated with the Erlang 
pdf has virtually disappeared for k>2. When p is increased 
beyond 3, the pdf's of the various processes are nearly 
indistinguishable, differing only slightly from the 
exponential. 
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k Pp E(x] Vix] cC*[x] | g,(0+) = £, (0+) 


2 


2 2 Vr 1625/0" 625 159) 1255 
a A 2/3. 309/269 .239) 229 
a V2 1185/4". 740 318A .215 
2 LS ome WO TB 398) 206 
2 6 1/3d 088/A° 798 TTA ,199 
ie fee 2/h 1.82/25 455 0398. 175 
ie) 3 W/3.—-1.01/4* 568 0596, 140 
ho 4 Va 643/A° 643 .0796A 124 
aS W/5A AUS/X© 691 09952 £115 
ee, 6 2/3... 326/a 73H 1194 108 
pile 2 Yd 3.647%" 405 O1TT7A ici 
a 3 o/h 2.1N/ 536 02652 .099 
6 4 3/2. —-1.39/A° —-.620 0354. .095 


Figure VITI.C.5 Data derived from E(k,p) pdf analyses. 
Observe that C“(x) decreases with k and increases with p, 
while Econ) decreases with increase in either k or pb. 
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eoefficient of variation as in (7.B.11) to provide the value 
of the initial point of the interval spectrum. 

The quantities thus obtained were used to verify those 
obtained through spectral analysis. In each case, positive 
verification was achieved. 

A summary of the key values related to pdf analysis for 
certain E(k,p) processes are tabulated in Figure VIII.C.5. 
Viti.D. NUMERICAL REPRESENTATION OF THE INTERVAL BISPECTRUM 

OF A SEMI-MARKOV GENERATED POINT PROCESS 

In Chapter V, Section C, the procedure for generating 
higher order spectra was outlined, with a specific form 
given for the interval bispectrum of a semi-Markov generated 
Point process (5.C.10),. Evaluation of (5.C.10) hinges, as 
with the interval spectrum, on the matrix (Iu-T)7+, as in 
section B of this chapter. For this reason, any of the 
treatments of Section VIII.B may be applied to this problem. 
For purposes of illustration, the numerical approximation 
method (VIII.B.3) was selected to evaluate and plot the 
bispectrum of intervals in the E(5,2), E(5,3) and E(3,5) 
processes from their semi-Markov generated point process 
Bepresencation. 

The results of this procedure are illustrated in Figures 
VIII.D.1 through VIII.D.6. It will be recalled from 
Section V.C that the bispectrum may be defined on any one 
of twelve sectors of the real plane. The examples illustrated 


mir chis’ Section are-shown in° the sector defined by O0<w.<w 


< 
gaya": 
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Two views are shown of each bispectru, the first is the 
view from the positive quadrant back toward the origin. 
Tne second view is from the negative quadrant looking over 
the positive quadrant. 

Since the bispectrum is a complex valued function, it 
was decided to plot the absolute value of each point. Also, 
the bispectral values were scaled by a factor of 10 to 
exagerate the surface shape. With the scale for all axes 
the same, the absolute bispectrum looks almost flat, a 
matter of some concern if the bispectrum of some data is to 


be estimated. 


VIII.E. INTERVAL SERIAL CORRELATION CORFFICIENTS 

In a mixed autoregressive/moving average process of 
orders m and n respectively, it was noted in Section III1.E 
that the serial correlation coefficients for lags greater 
than n can be expressed as 


+ eo (8.E.1) 


Bie 1 Pied Fane mm? 
RemaiOor DOrtion Of model identification analysis 
involves determining n, m and fa, } from the sequence of 

serial correlation estimates (Box and Jenkins(1970)). 


Where n and m and {p,3 are known, the coefficients aj, can 


be determined from the linear system 


2 38 











(1,7,.027) [ts 


(17,0) 
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migure VIII.D.1 

Absolute bispectrum of the E(5,2) interval process. This 

and Fig. VIII.D.2 are isometric projections of the E(5,2) 

bispectrum. Only one octant is shown as the values are 

reflected in the adjacent octant. Saverprevarson OL “tins 

type of representation remains an Olen Cuestion, Construceicn 
Meet this and the following bispectral representations was by 

method of approximation. ; 








This is a view of 


a 

pp’ SELF FFE 
PDE IS ZI 
oes 


ant 


the E(5,2) absolute bispectrum of intervals 
looking toward the origin from the first quadrant. 


Absolute bispectrum of the E(5,2) interval 


igure VIII.D.2 
process (Reverse view). 


m.0, .027 
(70,0) 
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(0,0,.647) 


—— ee i ee ee ee ey 





(0,0,.0) 


The jagged 


This and Figure VIII.D.4 represent the 


spectrum of the E(5,3) process. 
mepearance may be due in part to the course grid used 


in the plot (40 x 40). 


Bagure VIII.D.3 Absolute bispectrum of intervals of the 


E(5,3) process. 


absolute bi 
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(7,7, .23) 


(1,7 ,0) 


(0,0, .647) 
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Cais is sae Vl eveot thine 42415. 2) 


che magnitude of the peaks is 


Absolute bispectrum of intervals for the 
Moout 10 times that of the E(5,2) process. 


mosOlute bispectrum looking back toward the origin from the 
mote that 


E(5,3) process (reverse view). 
marst quadrant. 


Figure VIII.D.4 
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(7,1, .0197), 


O57, 0) a 


Figure VIII.D.5 
Absolute bispectrum of intervals of the 
ms,5) process. This and Figure VIII.D.6 
are isometric projections of the E(3,5) 
absolute interval bispectrum. Note the 
relatively flat appearance, nearly vanishing 
meecne Oriein. This is similar to the second 
Order spectrum which flattens with increased p. 








(0,0, .00027) 
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the surface is 


(iemiye) and (1,317/4). 
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Figure VIII.D.6 Absolute bispectrum of the E(3,5) interval 
Obdserve that 


process (reverse view). 
Slightly wavey with the highest peak at (/2,m/2), with 


secondary peaks at (31/4,31/4), 





ss ao (8.E.2) 














If the actual order of the process is (m',n'), the 
following resuit is obtained from solution of the system 


eiverm DY (6.8.2): 


n'<n and mem’: The matrix of correlation coefficients 
will be singular 


mien or m'om : Equation (8.E.1) will not be satisfied 


for k>ntm using the coefficients 
derived from (8.E.2). 


This idea teads to a procedure for verification of the 
results of Section tiif.D wherein a method 1s presented for 
determining the order of the polynomials which make up the 
interval spectrum of an E(k,p) process. 

When the process being studied has been given an 
equivalent semi-Markov generated point process representation, 
the serial coefficients may be obtained directly form (5.8.3) 
and (5.B.4) which give the covariance and variance as 
functions of powers of the transition matrix, T. If only a 


ppectral representation 1s available, as for example output 
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of SPECD (Subsection VIII.A.1), the spectrum must be inverted 
to produce the seriait correlation coefficients. 
Recall from (2.4.3.3) that 


fe a) 


fae) = {lobe 2 


ps cos jw} /T7 » O<w<T . (Onn. 3) 
Jas 


The inverse relation (see for example Cox and Lewis(1966, 


Chet) as 


Tt 
a f f,(w) cos ju dw (8.E.4) 
@) 


A discrete approximation of (8.E.3) 


N 
f,(w) = {l+2 2 ™; cos jw, s/n , COB eS) 
j=l 
where Ww, = mn/N, n=0,...,N-l1. The inverse relation of 
(oene5) Is 
Es N-1l 
- aa Vi a fw) cos ju, , I-05 beau aN=T 
(8.E.6) 


where ™/N represents the separation between on and Oty: 
The equations (8.E.5) and (8.E.6) represent a finite 
pourier transform pair, with communication between the cwo 


representations easily handled by the Fast Fourier Transform 


Algorithm (See for example Cooley, Lewis and Welch (1967)). 
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The key property of the finite Fourier transform which is 
Bhe basis for the fast Fourier transform is that the transform 
of a sequence of N=2" points can be written as the sum of n 
pranstorms: Of alengums 2, 2, an 2° ee ee . since each 
transform of length r requires approximately r* operations, 
the number of steps required by the fast Fourier transform 
is nN=Nlog.N as compared with an N point transform requiring 
Ne operations. 

The program package FORT/RFORT supplied by IBM was used 
in this analysis. Figure VIII.E.1 1s a comparison of the 
E(8,2) process correlation structure as determined by SPECD, 
FORT/RFORT, and as determined by the approximation method 
applied to the semi-Markov representation of this process. 
The parameter k=8 accentuates the differences in the 
procedures which are indistinguishable for smaller k. 

The correlation structure of additional processes is 


tabulated in Appendix D. 


Piritiah se COUNT SPECTRA OF THE t(k,p) PROCESS 

The second order count spectrum of an E(k,p) process is 
given by (3.C.6). Direct numerical evaluation of this form 
POrevari1ous values Of k is shown in Figure VIlI.F.1. Because 
Che count spectrum is linear in p, 4 value of p=l has been 
used for all computations. Two features are readily 
apparent from inspection of Figure VIII.F.1. The first is 
eMae Tor small k after the initial fluctuation the Spectrum 


er counts converges rapidly to 1/m. This fact 1s readily 


wemrried by taking the limit w-=™ in Equation (3.C.7). 
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mecure Viti .E.l. Comparison of SPECD and the approximation 
method of spectral representation. 


The accuracy and efficiency of two methods used for 
numerical approximation of the interval second order spectrum -: 
of the E(k,p) process are compared for the E(8,2) process. 


Method 1. Numerical approximation of the spectrum using 
SPECD (Vii l. A. 1) Feast Bourder transiornm.of 
spectrum to determine correlations and damping 
coefficients (32,768 and 4096 point approximations) 


Method 2. Numerical approximation of the equivalent semi- 
Markov generated point process (VIII.B.3) 


METHOD 1 METHOD 2 

Number of points 32,768 4096 200 

CPU Time 8 min 1 min 6 sec 

Core HUSK 202K PUCK 

Spectrum Same Same Same 

Correlations: 7. =0.52122 =) 252023 -0.52123265925713 
2 “Oneal as 0.28154 0.2815 3949321523 
3 -0.14812 -0.14812 -0.14813039568207 
4 0.078694 0.078695 0.07869925463138&0 

Coefficients 1 -0.0091941 -0.611426 0.000015258401560525 
2 0.13558 0.16640 0.0329589905490S3 
3. -0.24262 -0.17664 -0.4687499&699262 

Error 107° 107° 10714 


The differences in precision between Methods 1 and 2 
Jie in the fact that only single precision results are 
mecurneda from SPECD and FORT/RFORT although double precision 
arithmetic is used in both programs. 


-The E(8,2) case accentuates differences. In those cases 
for which the spectrum has a flatter appearance, the camping 
Boetiicients are nearly the same from either method. 


The error is based on the comparisons 


ae) = ae 
Pn+l Pn+1 Pn 1 Pane-mt1 en 


and _ 
: = + saa, oF 
ares ee, oe On —_mt2 em 
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The second observation from Figure VIII.F.1 is that 
the count spectra doe not exhibit the strong dependence on 


k observable in the interval spectra. 
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APPENDIX A NOTATION 


General Forms 


F(x), F(x): probability distribution functions 
ROX). R(x): survivor functions 
Z(x): equilibrium excess (forward recurrence 


time) distribution 
ow f(x): probability density functions 


E(-), Var(+): expected value and variance 


o(h): a function that vanishes more rapidly 
than h 

Coe): coefficient of variation 

Conventions 


Superscript *: Laplace transform 


Superscript (p): The superscripted symbol refers to a 
Superposition point process 


AyA4: scale parameters of Erlang and hyper- 
exponential distributions 

LH: the expected value of an interval in a 
renevial process, or an arbitrary interval 
in a stationary point process 

ce the variance of an interval in a renewal 
BrCCeESS. Or an arortrary anverval in a 
Stationery poOine process 

lag) the largest integer less than or equal 
TO.x 

2s tHdependentw<ldenulealily distwibuted;: 
refers to either random variables or 
component processes in a superposition 

Demet Upper icase Jetters : sSeUs-) Vectlors 

Scripts lower case levrers: (sets, vectors 


ai 





Underlined lower case letters: vectors 

Gothic, upper case letters: matrices 

Reserved symbols: Unless otherwise specifically noted, 
k is the shape parameter of an Erlang 


distribution: p is the number of 
components in a superposition 


Point Process Notation 


N(t): asynchronous counting process (II.A.1) 

Np(t): synchronous counting process (II.A.1) 

{x}: synchronous interval process (II.A.1) 

{W,L,,b55...3: asynchronous interval process (II.A.1) 

it Gee ee asynchronous mean-time curve (2.A.2.2) 

met) m4: asynchronous intensity (2.A.2.5) 

Mp(t): synchronous mean-time curve (2.A.2.4) 

mo(t): synchronous intensity (2.4.2.6) 

VieGa: variance-time curve (2.A.2.3) 

yee): covariance density of the counting process 
Can haes 10) 

g, (w): second order spectrum of counts (2.A.2.13) 

6s Gin ne ee generating function of the asynchronous 


counting process (2.A.2.4) 
fi (w): second order spectrum of counts (2.A.3.3) 


{p53}: serial correlation sequence (2.A.3.7) 


Semi-Markov Generated Point Process Notation 


[oe {t, 433 Transition matrix (V.A) 

F(u) = {f,,Cu)t: Cranst tions time. Par mmareix (V.A) 
ia oa ee Gee 

E. tus, } {E Sy } sD rietris of seth transition tame 


moments (V.A) 





Tv: stationary vector associated with 


(Sail) 
G(u) = {t,5%,, (wt: weighted transition time pdf 
Macrax (V¥s8) 
Z Cone = 
M {ty 5hy, }: weighted r-th moment matrix (V.B) 
T: the steady state transition matrix (5.3.2) 
v( 1): interval covariance of j lags (5.B.9) 
tele te): interval trivariance of j and k lags 
(526.1) 
x 
Tce )°: Laplace transform of t(j,k), 0 < j<k 
CG ) 
x 
i a): Laplace transform of t(j,j), 0 < j 
(5.26 alto) 
x 
tT (a): Laplace transform of T(0,J), 0 < Jj 
(5400.7) 
a:b: CrPansition from state 4a to b 
b(w, sW5): the bispectrum of intervals 


Special Notation 


mGeep) the superposition of p iid k-Erlang 
renewal processes (II.A.5) 


PL Gleig Onan). = the superposition of p iid hyperexponential 
processes with parameter vector iA and 
provability mass function g. (1174.5) 


ARMA(m,n): an autoregressive/moving average process 
of degrees m and n respectively (I.F.1) 


Se individual terms in the E(k,p) interval 
Spectrum. ( shied 2 3) 

a,b), ,¢,: individual terms in the E(k,p) interval 
spectrum: revised index (3.A.2.3) 

yk%e (ny, special index set for the E(k,p) interval 
spectrum - k even (3.C.3) 

¥_ (kA): the k-Erlang pdf (2.A.5.1) 
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APPENDIX B: COSINE CONVERSION FORMULA 


1. Convert cosy exe) 


J 


i ee 


; Oy. 4 COS jw 


—k 
2 (a, 9th, .cOs Curtoy COS tut. ..+0, cos kw), k even 
cos*w = 


2" (a, cos urtoy 00S But... +01, COS kw), k odd 


Og = 1) pea? oO en 
= + = 
ya = —[ag Oo Cuan. » K=3505 
a = a 2 5 e253 54 gee 5) K=354555 


kn k-ljn-1 ~ “k-l,jnt1l 


Onk ae 3 Kol 52 585s 
oon "OL = 
k : 
Be wrconVvert. COS ku to. 2 a,cos? u (Tschebysheff Polynomials) 
Jo) 
cos Ow = 1 
eos, 1W = cos uw 


cos kw = 2cos w cos{(k-1)w} - cos{(k-2)w}, k=3,4,5 





APPENDIX C 


Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(2,3) process 


1 M 2 
3 cia 3° 
a M 2 
3 ae oe 
2 1 
ny 3 34 


Transition density shape parameter matrix of the semi-Markov 
point process equivalent to the E(2,3) process 


2 3 y 
1 2 is 
0 a 2 
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Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(2,4) process 


at 6 18 6 
qe q? qe i 
at 6 18 6 
os qe qe qe 
0 2 6 2 

ye ye ye 
5 i 
0 0 TT rf 


Transition density shape parameter matrix of the semi-Markov 
point process equivalent to the E(2,4) process 


2 3 fh > 
1 2 3 y 
0 1 re 3 
lo 0 1 2 | 
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Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(2,5) process 


fal 8 36 96 24 

5 52 53 54 5e 

i 8 36 96 24 

5 52 53 5% 54 
0 re 9 en 

5 52 53 53 

Bon en 

2 5 EE 52 

y 7 

° : : 3 5 


Transition density shape parameter matrix of the semi-Markov 
point process equivalent to the E(2,5) process 


2 3 4 5 6 
i} 2 3 4 5 
0 1 2 3 \ 
0 0 1 2 3 
0 0 0 i 2 


aon 





Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(3,2) process 


on eS =e 
22 23 On 
as mi: 38 
22 23 23 
ao 1 1 
2 oe o2 


Transition density shape parameter matrix of the semi-Markcv 
point process equivalent to the E(3,2) process 


3 \ 5 
2 3 r 
\2 2 3 
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Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(3,3) process 





Ht Ht 20 10 
eg ow 33 af a 
g22 ye ye 20 10 
3? 33 33 3% 3% 
y 2 y 2 
35 BF 36 33 a. 
3 y 5 8 
ae ae oe a2 3 
a en 1 2 i 
3 37 37 37 ao 
ue 2 
° 3 : 37 30 


Transition density shape parameter matrix of the semi-Markov 
point process equivalent to the E(3,3) process 


3 4 5 5 6 7 
2 3 y l 5 6 
as 2 S 3 y 2 
0 2 3 3 4 2 
0 al 2 a 3 4 
0 0 1 0 2 3 


eng 





Transition probability matrix of the semi-Markov generated point process 


equivalent to the E(3,5) process 


Ee ia ere dates 
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Transition probability matrix of the semi-Markov generated 
point process equivalent to the E(5,2) process 


7 ee id 2 ol 
ae 25 26 27 2a 
st mon 13 oD. 22 
2% 25 26 27 27 
te oo ait 13 15 
23 24 25 26 26 
-s = a8 = De 
22 2? Be 25 25 
i i i 1 i 
| 2 22 23 24 24 


Transition density shape parameter matrix of the semi-Marxov 
point process ecuivalent to the E(5,2) process 


5 6 7 8 9 
4 5 6 7 8 
3 y 5 6 7 
e 3 M 5 6 
1 2 3 u 5 
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Transition probability matrix of the semi-Markov generated point process 


@quivalent to the E(5,3) process 
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Transition density shape parameter matrix of the semi-Markov point process 


equivalent to the E(5,3) process 
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Transition probability matrix of the semi-Markov generated 


point process equivalent to the E(8,2) process 
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point process equivalent to the E(8,2) process 


8 


= WwW oF =) 


IN > 


= 


9 
8 


[Fw OO OS 


MPO WwW 


10 


NON ~l jw wo 


Wh 


265 


HN 


14 
13 


=—J CO \O 


Bmx] 
~ [ 
ed 
end 


A tag 
ie, 
2S 
row 


rm Ir 
{ON 
Qo 


Oe |e 
~ 


NO 
~ 


J} 





MN 
wi 


i 
24 | 





15 


14 





APPENDIX D 


Serial correlations, {p.} . and damping factors {a, } i 
J° j=l =) 
for selected E(k,p) processes. Each E(k,p) process has a 
similar ARMA(m,n) process, with m and n estimated in 
Figure III.C.1. For indices greater than n, the serial 


correlation is given by 


Ps ="0.50, 97 see tT P.O. fon 

Those processes marked with a single asterisk had 
correlations computed from their semi-Markov generated 
point process representation using (5.B.3) and (5.B.4). 
Correlations for the remaining processes were determined 
from aiiast rourier transiorm of the interval spectrum as 
determined by SPECD. (VIII.A.1 and VIII.E) 

Processes marked with a double asterisk have parameters 


meer nh less than indicated in Figure I11.C.1. 


Process: E(2,2) Similar Process:ARMA(0,1) 
7 Ps : “4 
1 ~O.1 
eo... 0 Ze ra 6 
fell = 0 
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E25 3)5 


ri 
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E(2,4)* 
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-0..04428 
-0.01503 
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E(2.0) 
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Similar Process: ARMA(1,2) 


pt a, 


i pelea le eal (1/9) 
le| < 1072? 
Similar Process: ARMA(1,3) 
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Similiar Process: ARMA(2,4) 
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Similar Process: ARMA(2,5) 
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2 so 7007] 
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Similar Process: ARMA(1,2) 
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Process: E(3,3)* Similar Process: ARMA(2,4) 


: | a O41 
1 -0.18847 il: -0.03704 
2 -0.05455 2 nora © 
le| < 107)" 
Process: E(3,4) Similar Process: ARMA(4,6) 
Sy ss 
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3 -~0.01731 3 Oe 0eL92 
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5) Om 0 10 
6 0.00044 _2 
foie sk0 
Process: E(3,5)* Similar Process: ARMA(6,8)*# 
: ei * 4 
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8 0.00018 eal << 1,0 
Process: E(4,2) Similar Process: ARMA(1,2) 
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Process: E(4,3) Similar Process: ARMA(3,5) 
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Similar Process: ARMA(5 ,8) 
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Similar Process: ARMA(2,3) 
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SPECTRUM BY NUMERICAL APPROXIMATION 
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SPECTRUM BY ALGEBRAIC INVERSION 
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